Individual differences in impulsive and risky choice: effects of environmental rearing conditions

Effects of economic context and reward amount on delay and probability discounting

Steep delay and shallow probability discounting are associated with myriad problem behaviors; thus, it is important to understand factors that influence the degree of discounting. The present study evaluated the effects of economic context and reward amount on delay and probability discounting. Two hundred thirteen undergraduate psychology students completed four delay- or probability-discounting tasks. Participants were exposed to hypothetical narratives involving four bank amounts ($750, $12,000, $125,000, and $2,000,000). The delayed/probabilistic amount was $3,000 for the two smaller bank amounts and $500,000 for the two larger bank amounts. The discounting tasks included five delays to, or probabilities of, receipt of the larger amount. The area under the empirical discounting function was calculated for each participant. Participants discounted delayed and uncertain outcomes more when the bank amount was smaller than the outcome (i.e., the economic context was low). Participants discounted the delayed larger amounts less than delayed smaller amounts, even when the relative economic context was the same. In contrast, probability discounting did not differ across magnitudes, which suggests that economic context may attenuate the magnitude effect in probability discounting. The results further highlight the importance of considering the economic context in delay and probability discounting.

The systemic effects of the enriched environment on the conditioned fear reaction

In this review, a hypothesis is proposed to explain the beneficial effect of an enriched environment (EE) on the conditioned fear reaction (CFR) from the perspective of a functional system of behavioral control. According to the hypothesis, the EE affects all behavioral act components, including the processing of sensory information, memory, motivational and reinforcing systems, and motor activities, which weakens the CFR. Animals raised in the EE have effects that are comparable to those of context (CTX) and CS pre-exposures at latent inhibition. An abundance of stimuli in the EE and constant contact with them provide the formation of CS-noUS and CTX-noUS connections that later, during CFR learning, slow down and diminish fear. The EE also contributes to faster processing of information and habituation to it. As a result, many stimuli in the context lose their significance, and subjects simply ignore them. And finally, the EE affects the motivational and reinforcing brain mechanisms, induces an impairment of search activity, and worsens memory consolidation, which leads to a reduction of CFR.

Constitutive depletion of brain serotonin differentially affects rats' social and cognitive abilities

Central serotonin appears a promising transdiagnostic marker of psychiatric disorders and a modulator of some of their key behavioral symptoms. In adult male Tph2 -/- rats, constitutively lacking central serotonin, we tested individual's cognitive, social and non-social abilities and characterized group's social organization under classical and ethological testing conditions. Using unsupervised machine learning, we identified the functions most dependent on serotonin. Although serotonin depletion did not affect cognitive performances in classical testing, in the home-cage it induced compulsive aggression and sexual behavior, hyperactive and hypervigilant stereotyped behavior, reduced self-care and exacerbated corticosterone levels. This profile recalled symptoms of impulse control and anxiety disorders. Serotonin appeared essential for behavioral adaptation to dynamic social environments. Our animal model challenges the essential role of serotonin in decision-making, flexibility, impulsivity, and risk-taking. These findings highlight the importance of studying everyday life functions within the dynamic social living environment to model complexity in animal models.

Concurrent measures of impulsive action and choice are partially related and differentially modulated by dopamine D1- and D2-like receptors in a rat model of impulsivity

Impulsivity is a multidimensional construct, but the relationships between its constructs and their respective underlying dopaminergic underpinnings in the general population remain unclear. A cohort of Roman high- (RHA) and low- (RLA) avoidance rats were tested for impulsive action and risky decision-making in the rat gambling task, and then for delay discounting in the delay-discounting task to concurrently measure the relationships among the three constructs of impulsivity using a within-subject design. Then, we evaluated the effects of dopaminergic drugs on the three constructs of impulsivity, considering innate differences in impulsive behaviors at baseline. Risky decision-making and delay-discounting were positively correlated, indicating that both constructs of impulsive choice are related. Impulsive action positively correlated with risky decision-making but not with delay discounting, suggesting partial overlap between impulsive action and impulsive choice. RHAs showed a more impulsive phenotype in the three constructs of impulsivity compared to RLAs, demonstrating the comorbid nature of impulsivity in a population of rats. Amphetamine increased impulsive action and had no effect on risky decision-making regardless of baseline levels of impulsivity, but it decreased delay discounting only in high impulsive RHAs. In contrast, while D₁R and D₃R agonism as well as D_2/3R partial agonism decreased impulsive action regardless of baseline levels of impulsivity, D_2/3R agonism decreased impulsive action exclusively in high impulsive RHAs. Irrespective of baseline levels of impulsivity, risky decision-making was increased by D₁R and D_2/3R agonism but not by D₃R agonism or D_2/3R partial agonism. Finally, while D₁R and D₃R agonism, D_2/3R partial agonism and D₂R blockade increased delay discounting irrespective of baseline levels of impulsivity, D_2/3R agonism decreased it in low impulsive RLAs only. These findings indicate that the acute effects of dopamine drugs were partially overlapping across dimensions of impulsivity, and that only D_2/3R agonism showed baseline-dependent effects on impulsive action and impulsive choice.

Survey on the Past Decade of Technology in Animal Enrichment: A Scoping Review

Simple Summary

Enrichment is important for supporting the well-being of captive animals. Enrichment increase animal quality of life through encouraging natural behaviours. As enrichment is shifting to a more centered role in animal care, technology is becoming increasingly accessible and is becoming embedded in animal enrichment in creative ways. This review explores the trends in technology usage in animal enrichment studies. Through pulling the past decade of technology enrichment work together, we discuss gaps such as needing to include a larger variety of species (extending passed mammals), ensuring enrichment designs focus primarily on the senses an animal uses to interact with the world rather than human senses, and encouraging similar study designs across animal contexts to allow for streamlined comparisons.

Abstract

Environmental enrichment is adding complexity to an environment that has a positive impact on a captive animal as a necessity of care. Computing technology is being rapidly weaved throughout the space in both enrichment devices as well as evaluating enrichment outcomes. In this article, we present a scoping review of 102 captive animal enrichment studies and propose a contextual lens for exploring current practices. We discuss the importance of directed growth in species inclusion, transitioning beyond anthro-centric designs, and utilizing shared methodologies.

Early environmental enrichment and impoverishment differentially affect addiction-related behavioral traits, cocaine-taking, and dopamine D2/3 receptor signaling in a rat model of vulnerability to drug abuse

RATIONALE

Risk factors for drug addiction include genetics, environment, and behavioral traits such as impulsivity and novelty preference (NP), which have been related to deficits in striatal dopamine (DA) D_2/3-receptors (D_2/3R) and heightened amphetamine (AMPH)-induced DA release. However, the influence of the early rearing environment on these behavioral and neurochemical variables is not clear.

OBJECTIVES

We investigated the influence of early rearing environment on striatal D_2/3R availabilities and AMPH-induced DA release in relation to impulsivity, NP, and propensity to drug self-administration (SA) in "addiction-prone" Roman high- (RHA) and "addiction-resistant" Roman low-avoidance (RLA) rats.

METHODS

Animals were reared post-weaning in either environmental enrichment (EE) or impoverishment (EI) and were assessed at adulthood for impulsivity, NP, and propensity to cocaine SA. EE and EI rats were also scanned using single-photon emission computed tomography to concurrently measure in vivo striatal D_2/3R availability and AMPH-induced DA release.

RESULTS

EE vs. EI was associated with heightened impulsivity and a lack of NP in both rat lines. Higher dorsal striatal D_2/3R densities were found in RHA EE and higher AMPH-induced DA release in RLA EE. Both impulsivity and NP were negatively correlated to dorsal striatal D_2/3R availabilities and positively correlated with AMPH-induced DA release in EI but not in EE. EE vs. EI was related to a faster rate of cocaine intake and elevated active timeout responses in RHAs.

CONCLUSION

Our results suggest non-monotonic, environment-dependent, relationships between impulsivity, NP, and D_2/3R-mediated signaling, and suggest that EI vs. EE may decrease the reinforcing effects of psychostimulants in predisposed individuals.

Better, Not Just More-Contrast in Qualitative Aspects of Reward Facilitates Impulse Control in Pigs

Delay-of-gratification paradigms, such as the famous "Marshmallow Test," are designed to investigate the complex cognitive concepts of self-control and impulse control in humans and animals. Such tests determine whether a subject will demonstrate impulse control by choosing a large, delayed reward over an immediate, but smaller reward. Documented relationships between impulsive behavior and aggression in humans and animals suggest important implications for farm animal husbandry and welfare, especially in terms of inadequate social behavior, tail biting and maternal behavior. In a preliminary study, we investigated whether the extent of impulse control would differ between quantitatively and qualitatively different aspects of reward in pigs. Twenty female piglets were randomly divided into two groups, with 10 piglets each. After a preference test to determine individual reward preference among six different food items, a discrimination test was conducted to train for successful discrimination between different amounts of reward (one piece vs. four pieces) and different qualitative aspects of reward (highly preferred vs. least preferred food item). Then, an increasing delay (2, 4, 8, 16, 24, 32 s) was introduced for the larger/highly preferred reward. Each piglet could choose to get the smaller/least preferred reward immediately or to wait for the larger/highly preferred reward. Piglets showed clear differences in their preference for food items. Moreover, the "quality group" displayed faster learning in the discrimination test (number of sessions until 90% of the animals completed the discrimination test: "quality group"-3 days vs. "quantity group"-5 days) and reached a higher level of impulse control in the delay-of-gratification test compared to the "quantity group" (maximum delay that was mastered: "quality group"-24 s vs. "quantity group"-8 s). These results demonstrate that impulse control is present in piglets but that the opportunity to get a highly preferred reward is more valued than the opportunity to get more of a given reward. This outcome also underlines the crucial role of motivation in cognitive test paradigms. Further investigations will examine whether impulse control is related to traits that are relevant to animal husbandry and welfare.

Environmental Enrichment Results in Both Brain Connectivity Efficiency and Selective Improvement in Different Behavioral Tasks

Exposure to environmental enrichment (EE) has been a useful model for studying the effects of experience on brain plasticity, but to date, few is known about the impact of this condition on the brain functional networks that probably underlies the multiple behavioral improvements. Hence, we assessed the effect of an EE protocol in adult Wistar rats on the performance in several behavioral tasks testing different domains (Open field (OP): locomotor activity; Elevated-zero maze (EZM): anxiety-related behaviors; 5-choice serial reaction time task (5-CSRTT): attentional processes; 4-arm radial water maze (4-RAWM): spatial memory) in order to check its effectiveness in a wide range of functions. After this, we analyzed the functional brain connectivity underlying each experimental condition through cytochrome C oxidase (COx) histochemistry. Our EE protocol reduced both locomotor activity in the OP and anxiety-related behaviors in the EZM. On the other hand, enriched rats showed more accuracy in the 4-RAWM, whereas 5-CSRTT performance was not significantly ameliorated by EE condition. In relation to COx functional connectivity, we found that EE reduced the number of strong positive correlations both in basal and training conditions, suggesting a modulating effect on specific brain connections. Our results suggest that EE seems to have a selective effect on specific brain regions, such as prefrontal cortex and hippocampus, leading to a more efficient brain connectivity.

A marker of biological ageing predicts adult risk preference in European starlings, Sturnus vulgaris

Why are some individuals more prone to gamble than others? Animals often show preferences between 2 foraging options with the same mean reward but different degrees of variability in the reward, and such risk preferences vary between individuals. Previous attempts to explain variation in risk preference have focused on energy budgets, but with limited empirical support. Here, we consider whether biological ageing, which affects mortality and residual reproductive value, predicts risk preference. We studied a cohort of European starlings (Sturnus vulgaris) in which we had previously measured developmental erythrocyte telomere attrition, an established integrative biomarker of biological ageing. We measured the adult birds' preferences when choosing between a fixed amount of food and a variable amount with an equal mean. After controlling for change in body weight during the experiment (a proxy for energy budget), we found that birds that had undergone greater developmental telomere attrition were more risk averse as adults than were those whose telomeres had shortened less as nestlings. Developmental telomere attrition was a better predictor of adult risk preference than either juvenile telomere length or early-life food supply and begging effort. Our longitudinal study thus demonstrates that biological ageing, as measured via developmental telomere attrition, is an important source of lasting differences in adult risk preferences.

Environmental Enrichment as a Positive Behavioral Intervention Across the Lifespan

BACKGROUND

In recent decades, the interest in behavioral interventions has been growing due to the higher prevalence of age-related cognitive impairments. Hence, behavioral interventions, such as cognitive stimulation and physical activity, and along with these, our lifestyle (education level, work position, frequency of cognitive and social activities) have shown important benefits during the cognitive impairment, dementia and even recovery after brain injury. This is due to the fact that this type of intervention and activities promote the formation of a cognitive and brain reserve that allows tolerating brain damage during a long period of time without the appearance of cognitive symptoms. With regard to this, animal models have proved very useful in providing information about the brain mechanisms involved in the development of these cognitive and brain reserves and how they interact with each other.

METHODS

We summarize several studies showing the positive effects of Environmental Enrichment (EE), understood as a housing condition in which animals benefit from the sensory, physical, cognitive and social stimulation provided, on brain and cognitive functions usually impaired during aging.

RESULTS

Most of studies have shown that EE is a successful protocol to improve cognitive functions and reduce anxiety-related behaviors across the lifespan, as well as in animal models of neurodegenerative diseases.

CONCLUSION

Therefore, EE is a laboratory condition in which some aspects of an active lifestyle are reproduced.

Developmental social isolation affects adult behavior, social interaction, and dopamine metabolite levels in zebrafish

The zebrafish is a social vertebrate and an excellent translational model for a variety of human disorders. Abnormal social behavior is a hallmark of several human brain disorders. Social behavioral problems can arise as a result of adverse early social environment. Little is known about the effects of early social isolation in adult zebrafish. We compared zebrafish that were isolated for either short (7 days) or long duration (180 days) to socially housed zebrafish, testing their behavior across ontogenesis (ages 10, 30, 60, 90, 120, 180 days), and shoal cohesion and whole-brain monoamines and their metabolites in adulthood. Long social isolation increased locomotion and decreased shoal cohesion and anxiety in the open-field in adult. Additionally, both short and long social isolation reduced dopamine metabolite levels in response to social stimuli. Thus, early social isolation has lasting effects in zebrafish, and may be employed to generate zebrafish models of human neuropsychiatric conditions.

Blockade of α2-adrenergic receptors in prelimbic cortex: impact on cocaine self-administration in adult spontaneously hypertensive rats following adolescent atomoxetine treatment

RATIONALE

Research with the spontaneously hypertensive rat (SHR) model of attention deficit/hyperactivity disorder demonstrated that chronic methylphenidate treatment during adolescence increased cocaine self-administration established during adulthood under a progressive ratio (PR) schedule. Compared to vehicle, chronic atomoxetine treatment during adolescence failed to increase cocaine self-administration under a PR schedule in adult SHR.

OBJECTIVES

We determined if enhanced noradrenergic transmission at α2-adrenergic receptors within prefrontal cortex contributes to this neutral effect of adolescent atomoxetine treatment in adult SHR.

METHODS

Following treatment from postnatal days 28-55 with atomoxetine (0.3 mg/kg) or vehicle, adult male SHR and control rats from Wistar-Kyoto (WKY) and Wistar (WIS) strains were trained to self-administer 0.3 mg/kg cocaine. Self-administration performance was evaluated under a PR schedule of cocaine delivery following infusion of the α2-adrenergic receptor antagonist idazoxan (0 and 10-56 μg/side) directly into prelimbic cortex.

RESULTS

Adult SHR attained higher PR break points and had greater numbers of active lever responses and infusions than WKY and WIS. Idazoxan dose-dependently increased PR break points and active lever responses in SHR following adolescent atomoxetine vs. vehicle treatment. Behavioral changes were negligible after idazoxan pretreatment in SHR following adolescent vehicle or in WKY and WIS following adolescent atomoxetine or vehicle.

CONCLUSIONS

α2-Adrenergic receptor blockade in prelimbic cortex of SHR masked the expected neutral effect of adolescent atomoxetine on adult cocaine self-administration behavior. Moreover, greater efficacy of acute idazoxan challenge in adult SHR after adolescent atomoxetine relative to vehicle is consistent with the idea that chronic atomoxetine may downregulate presynaptic α2A-adrenergic autoreceptors in SHR.

Diet-induced impulsivity: Effects of a high-fat and a high-sugar diet on impulsive choice in rats

Impulsive choice is a common charactertistic among individuals with gambling problems, obesity, and substance abuse issues. Impulsive choice has been classified as a trans-disease process, and understanding the etiology of trait impulsivity could help to understand how diseases and disorders related to impulsive choice are manifested. The Western diet is a possible catalyst of impulsive choice as individuals who are obese and who eat diets high in fat and sugar are typically more impulsive. However, such correlational evidence is unable to discern the direction and causal nature of the relationship. The present study sought to determine how diet may directly contribute to impulsive choice. After 8 weeks of dietary exposure (high-fat, high-sugar, chow), the rats were tested on an impulsive choice task, which presented choices between a smaller-sooner reward (SS) and a larger-later reward (LL). Then, the rats were transferred to a chow diet and retested on the impulsive choice task. The high-sugar and high-fat groups made significantly more impulsive choices than the chow group. Both groups became more self-controlled when they were off the diet, but there were some residual effects of the diet on choice behavior. These results suggest that diet, specifically one high in processed fat or sugar, induces impulsive choice. This diet-induced impulsivity could be a precursor to other disorders that are characterized by impulsivity, such as diet-induced obesity, and could offer potential understanding of the trans-disease nature of impulsive choice.

Differential effects of social and novelty enrichment on individual differences in impulsivity and behavioral flexibility

Early life experience profoundly impacts behavior and cognitive functions in rats. The present study investigated how the presence of conspecifics and/or novel objects, could independently influence individual differences in impulsivity and behavioral flexibility. Twenty-four rats were reared in an isolated condition, an isolated condition with a novel object, a pair-housed social condition, or a pair-housed social condition with a novel object. The rats were then tested on an impulsive choice task, a behavioral flexibility task, and an impulsive action task. Novelty enrichment produced an overall increase in impulsive choice, while social enrichment decreased impulsive choice in the absence of novelty enrichment and also produced an overall increase in impulsive action. In the behavioral flexibility task, social enrichment increased regressive errors, whereas both social and novelty enrichment reduced never-reinforced errors. Individual differences analyses indicated a significant relationship between performance in the behavioral flexibility and impulsive action tasks, which may reflect a common psychological correlate of action inhibition. Moreover, there was a relationship between delay sensitivity in the impulsive choice task and performance on the DRL and behavioral flexibility tasks, suggesting a dual role for timing and inhibitory processes in driving the interrelationship between these tasks. Overall, these results indicate that social and novelty enrichment produce distinct effects on impulsivity and adaptability, suggesting the need to parse out the different elements of enrichment in future studies. Further research is warranted to better understand how individual differences in sensitivity to enrichment affect individuals' interactions with and the resulting consequences of the rearing environment.

New Experimental Model of Rat Risk Behavior. Effects of Nicotine and Phenazepam

We described a new model of risk behavior in rats that allows selection of animals predisposed to risk behavior in the absence of other biological motivations. Phenazepam administration did not change the intensity of risk behavior in "risky" animals, but stimulated risk behavior in rats that were not predisposed to it. Nicotine inhibited risk behavior in "risky" animals and strengthened it in "cautious" rats. In the intermediate group, the drugs did not induce significant changes. A similar effect of the drugs was observed in the previous models. More complex effect of nicotine on the risk behavior may be explained by the absence of severe food motivation typical for the early models.

'Waiting impulsivity' in isolation-reared and socially-reared rats: effects of amphetamine

BACKGROUND

Rats reared in social isolation exhibit various cognitive and behavioural abnormalities in adulthood. However, impulsivity following this treatment still remains unclear, especially in response to medications used in attention deficit hyperactivity disorder, such as amphetamine.

METHODS

Using an isolation-rearing (IR) manipulation, the present study examined the effects of IR on impulsive action and impulsive choice when also treated with doses of D-amphetamine, by employing the five-choice serial reaction time task (5-CSRTT) and a temporal discounting of reward task (TDRT), respectively.

RESULTS

IR rats showed similar acquisition of the 5-CSRTT. Amphetamine increased premature responding in both groups; however, IR rats showed less responding overall. For the TDRT, IR rats revealed a greater preference for the large but delayed reward during task acquisition (i.e. were less impulsive) with a higher rate of nose poking during the delay, and exhibited a compressed dose-response function (i.e. reduced dose sensitivity) for amphetamine.

DISCUSSION

Impulsive action and impulsive choice were reduced in IR rats under certain conditions, and a blunted response to D-amphetamine was found on these measures. These reductions in impulsivity contrast with locomotor hyperactivity normally shown in IR rats and the findings have implications for the utility of IR as a model of psychopathology.

Concurrent progressive ratio schedules: Effects of reinforcer probability on breakpoint and response allocation

Although progressive ratio (PR) schedules have been used to explore effects of a range of reinforcer parameters (e.g., magnitude, delay), effects of reinforcer probability remain underexplored. The present project used independently progressing concurrent PR PR schedules to examine effects of reinforcer probability on PR breakpoint (highest completed ratio prior to a session terminating 300s pause) and response allocation. The probability of reinforcement on one lever remained at 100% across all conditions while the probability of reinforcement on the other lever was systematically manipulated (i.e., 100%, 50%, 25%, 12.5%, and a replication of 25%). Breakpoints systematically decreased with decreasing reinforcer probabilities while breakpoints on the control lever remained unchanged. Patterns of switching between the two levers were well described by a choice-by-choice unit price model that accounted for the hyperbolic discounting of the value of probabilistic reinforcers.

The effects of physical activity on impulsive choice: Influence of sensitivity to reinforcement amount and delay

Impulsive choice is a diagnostic feature and/or complicating factor for several psychological disorders and may be examined in the laboratory using delay-discounting procedures. Recent investigators have proposed using quantitative measures of analysis to examine the behavioral processes contributing to impulsive choice. The purpose of this study was to examine the effects of physical activity (i.e., wheel running) on impulsive choice in a single-response, discrete-trial procedure using two quantitative methods of analysis. To this end, rats were assigned to physical activity or sedentary groups and trained to respond in a delay-discounting procedure. In this procedure, one lever always produced one food pellet immediately, whereas a second lever produced three food pellets after a 0, 10, 20, 40, or 80-s delay. Estimates of sensitivity to reinforcement amount and sensitivity to reinforcement delay were determined using (1) a simple linear analysis and (2) an analysis of logarithmically transformed response ratios. Both analyses revealed that physical activity decreased sensitivity to reinforcement amount and sensitivity to reinforcement delay. These findings indicate that (1) physical activity has significant but functionally opposing effects on the behavioral processes that contribute to impulsive choice and (2) both quantitative methods of analysis are appropriate for use in single-response, discrete-trial procedures.

I can't wait: Methods for measuring and moderating individual differences in impulsive choice

Impulsive choice behavior occurs when individuals make choices without regard for future consequences. This behavior is often maladaptive and is a common symptom in many disorders, including drug abuse, compulsive gambling, and obesity. Several proposed mechanisms may influence impulsive choice behavior. These mechanisms provide a variety of pathways that may provide the basis for individual differences that are often evident when measuring choice behavior. This review provides an overview of these different pathways to impulsive choice, and the behavioral intervention strategies being developed to moderate impulsive choice. Because of the compelling link between impulsive choice behavior and the near-epidemic pervasiveness of obesity in the United States, we focus on the relationship between impulsive choice behavior and obesity as a test case for application of the multiple pathways approach. Choosing immediate gratification over healthier long term food choices is a contributing factor to the obesity crisis. Behavioral interventions can lead to more self controlled choices in a rat pre-clinical model, suggesting a possible gateway for translation to human populations. Designing and implementing effective impulsive choice interventions is crucial to improving the overall health and well-being of impulsive individuals.

Mechanisms of impulsive choice: III. The role of reward processes

Two experiments examined the relationship between reward processing and impulsive choice. In Experiment 1, rats chose between a smaller-sooner (SS) reward (1 pellet, 10 s) and a larger-later (LL) reward (1, 2, and 4 pellets, 30 s). The rats then experienced concurrent variable-interval 30-s schedules with variations in reward magnitude to evaluate reward magnitude discrimination. LL choice behavior positively correlated with reward magnitude discrimination. In Experiment 2, rats chose between an SS reward (1 pellet, 10 s) and an LL reward (2 and 4 pellets, 30 s). The rats then received either a reward intervention which consisted of concurrent fixed-ratio schedules associated with different magnitudes to improve their reward magnitude discrimination, or a control task. All rats then experienced a post-intervention impulsive choice task followed by a reward magnitude discrimination task to assess intervention efficacy. The rats that received the intervention exhibited increases in post-intervention LL choice behavior, and made more responses for larger-reward magnitudes in the reward magnitude discrimination task, suggesting that the intervention heightened sensitivities to reward magnitude. The results suggest that reward magnitude discrimination plays a key role in individual differences in impulsive choice, and could be a potential target for further intervention developments.

Adolescent D-amphetamine treatment in a rodent model of ADHD: Pro-cognitive effects in adolescence without an impact on cocaine cue reactivity in adulthood

Attention-deficit/hyperactivity disorder (ADHD) is comorbid with cocaine abuse. Whereas initiating ADHD medication in childhood does not alter later cocaine abuse risk, initiating medication during adolescence may increase risk. Preclinical work in the Spontaneously Hypertensive Rat (SHR) model of ADHD found that adolescent methylphenidate increased cocaine self-administration in adulthood, suggesting a need to identify alternatively efficacious medications for teens with ADHD. We examined effects of adolescent d-amphetamine treatment on strategy set shifting performance during adolescence and on cocaine self-administration and reinstatement of cocaine-seeking behavior (cue reactivity) during adulthood in male SHR, Wistar-Kyoto (inbred control), and Wistar (outbred control) rats. During the set shift phase, adolescent SHR needed more trials and had a longer latency to reach criterion, made more regressive errors and trial omissions, and exhibited slower and more variable lever press reaction times. d-Amphetamine improved performance only in SHR by increasing choice accuracy and decreasing errors and latency to criterion. In adulthood, SHR self-administered more cocaine, made more cocaine-seeking responses, and took longer to extinguish lever responding than control strains. Adolescent d-amphetamine did not alter cocaine self-administration in adult rats of any strain, but reduced cocaine seeking during the first of seven reinstatement test sessions in adult SHR. These findings highlight utility of SHR in modeling cognitive dysfunction and comorbid cocaine abuse in ADHD. Unlike methylphenidate, d-amphetamine improved several aspects of flexible learning in adolescent SHR and did not increase cocaine intake or cue reactivity in adult SHR. Thus, adolescent d-amphetamine was superior to methylphenidate in this ADHD model.

Developmental and familial predictors of adult cognitive traits in the European starling

In birds, there is evidence that adult cognitive traits can both run in families and be affected by early developmental influences. However, different studies use different cognitive tasks, which may not be measuring the same traits, and also focus on different developmental factors. We report results from a study in which we administered multiple cognitive tasks (autoshaping, discrimination learning, reversal learning, progressive ratio schedule, extinction learning and impulsivity) to a cohort of 34 European starlings, Sturnus vulgaris, for which several early developmental measures were available. The cohort consisted of siblings raised either apart or together, whose position in the size hierarchy of the rearing brood had been experimentally manipulated. We examined how the different cognitive measures covaried, the extent to which they ran in families, and which of the developmental factors predicted which of the cognitive outcomes. We found that discrimination and reversal learning speeds were positively correlated, as were breakpoint on the progressive ratio schedule and resistance to extinction. Otherwise, the cognitive measures were uncorrelated, suggesting that they reflected different underlying traits. All traits except discrimination and reversal learning speed ran in families to a substantial extent. Using a model selection approach, we found evidence that natal brood size and developmental telomere attrition (the extent to which the birds' erythrocyte telomeres shortened in early life, an integrative measure of developmental stress) were related to several adult cognitive measures. Results are discussed with respect to the best way of measuring avian cognitive abilities, and the utility of developmental telomere attrition as a predictor of adult outcomes.

•

Cognition in birds may be influenced by familial and developmental factors.

•

We administered cognitive tasks to 34 cross-fostered starlings from eight families.

•

Tasks were uncorrelated, except for two measures of learning and two of persistence.

•

Performance on most tasks ran in families.

•

Natal brood size and early life telomere loss were associated with cognition.

Mechanisms of impulsive choice: II. Time-based interventions to improve self-control

Impulsive choice behavior has been proposed as a primary risk factor for other maladaptive behaviors (e.g., gambling, substance abuse). Recent research has suggested that timing processes may play a key role in impulsive choice behavior, and could provide an avenue for altering impulsive choice. Accordingly, the current experiments assessed a set of time-based behavioral interventions to increase self-control while simultaneously assessing effects on timing processes within the impulsive choice task. Three experiments assessed temporal interventions using a differential reinforcement of low rates task (Experiment 1) and exposure to either a variable or fixed interval schedule (Experiments 2-3). The efficacy of the interventions was assessed in Sprague-Dawley (Experiments 1-2) and Lewis (Experiment 3) rat strains. Impulsive choice behavior was assessed by measuring preferences of a smaller-sooner (SS) versus a larger-later (LL) reward, while timing of the SS and LL durations was measured during peak trials within the impulsive choice procedure. The rats showed an increased preference for the LL following all three time-based interventions and also displayed increased temporal precision. These results add to the increasing evidence that supports a possible role for temporal processing in impulsive choice behavior and supply novel behavioral interventions to decrease impulsive behavior.

Relative gains, losses, and reference points in probabilistic choice in rats

Theoretical reference points have been proposed to differentiate probabilistic gains from probabilistic losses in humans, but such a phenomenon in non-human animals has yet to be thoroughly elucidated. Three experiments evaluated the effect of reward magnitude on probabilistic choice in rats, seeking to determine reference point use by examining the effect of previous outcome magnitude(s) on subsequent choice behavior. Rats were trained to choose between an outcome that always delivered reward (low-uncertainty choice) and one that probabilistically delivered reward (high-uncertainty). The probability of high-uncertainty outcome receipt and the magnitudes of low-uncertainty and high-uncertainty outcomes were manipulated within and between experiments. Both the low- and high-uncertainty outcomes involved variable reward magnitudes, so that either a smaller or larger magnitude was probabilistically delivered, as well as reward omission following high-uncertainty choices. In Experiments 1 and 2, the between groups factor was the magnitude of the high-uncertainty-smaller (H-S) and high-uncertainty-larger (H-L) outcome, respectively. The H-S magnitude manipulation differentiated the groups, while the H-L magnitude manipulation did not. Experiment 3 showed that manipulating the probability of differential losses as well as the expected value of the low-uncertainty choice produced systematic effects on choice behavior. The results suggest that the reference point for probabilistic gains and losses was the expected value of the low-uncertainty choice. Current theories of probabilistic choice behavior have difficulty accounting for the present results, so an integrated theoretical framework is proposed. Overall, the present results have implications for understanding individual differences and corresponding underlying mechanisms of probabilistic choice behavior.

Mechanisms of Individual Differences in Impulsive and Risky Choice in Rats

Individual differences in impulsive and risky choice are key risk factors for a variety of maladaptive behaviors such as drug abuse, gambling, and obesity. In our rat model, ordered individual differences are stable across choice parameters, months of testing, and span a broad spectrum, suggesting that rats, like humans, exhibit trait-level impulsive and risky choice behaviors. In addition, impulsive and risky choices are highly correlated, suggesting a degree of correlation between these two traits. An examination of the underlying cognitive mechanisms has suggested an important role for timing processes in impulsive choice. In addition, in an examination of genetic factors in impulsive choice, the Lewis rat strain emerged as a possible animal model for studying disordered impulsive choice, with this strain demonstrating deficient delay processing. Early rearing environment also affected impulsive behaviors, with rearing in an enriched environment promoting adaptable and more self-controlled choices. The combined results with impulsive choice suggest an important role for timing and reward sensitivity in moderating impulsive behaviors. Relative reward valuation also affects risky choice, with manipulation of objective reward value (relative to an alternative reference point) resulting in loss chasing behaviors that predicted overall risky choice behaviors. The combined results are discussed in relation to domain-specific versus domain-general subjective reward valuation processes and the potential neural substrates of impulsive and risky choice.