Home cage testing of delay discounting in rats

Poke And Delayed Drink Intertemporal Choice Task (POKE-ADDICT): An open-source behavioral apparatus for intertemporal choice testing in rodents

Advancements in neuroscience research present opportunities and challenges, requiring substantial resources and funding. To address this, we describe here "Poke And Delayed Drink Intertemporal Choice Task (POKE-ADDICT)", an open-source, versatile, and cost-effective apparatus for intertemporal choice testing in rodents. This allows quantification of delay discounting (DD), a cross-species phenomenon observed in decision making which provides valuable insights into higher-order cognitive functioning. In DD, the subjective value of a delayed reward is reduced as a function of the delay for its receipt. Using our apparatus, we implemented an effective intertemporal choice paradigm for the quantification of DD based on an adjusting delayed amount (ADA) algorithm using mango juice as a reward. Our paradigm requires limited training, a few 3D-printed parts and inexpensive electrical components, including a Raspberry Pi control unit. Furthermore, it is compatible with several in vivo procedures and the use of nose pokes instead of levers allows for faster task learning. Besides the main application described here, the apparatus can be further extended to implement other behavioral tests and protocols, including standard operant conditioning. In conclusion, we describe a versatile and cost-effective design based on Raspberry Pi that can support research in animal behavior, decision making and, more specifically, delay discounting.

Striatal dynamics as determinants of reduced gambling vulnerability in the NHE rat model of ADHD

The Naples High-Excitability (NHE) is a validated rat strain to model for a mesocortical variant of Attention Deficit Hyperactivity Disorder (ADHD). NHE rats' brains have a tuned-down cortical and a potentiated limbic loop (Zoratto et al., 2017). ADHD and comorbid pathological gambling (PG) involve similar deficits of prefrontal-striatal dialogue. This work aimed to understand if NHE rats (compared to normal random-bred rats, NRB) can be a useful model for gambling vulnerability in ADHD. Experiment 1 evaluated gambling proneness in NHE rats, namely attraction/avoidance in nose-poking for a "Large & Luck-Linked" (LLL) reward (versus a "Small & Sure" one, SS), when the probability of LLL delivery was progressively reduced. Experiment 2 assessed (by phMRI) differential responsivity of ventral (vStr) versus dorsal (dStr) striatum following a methylphenidate (MPH, 4 mg/kg I.P.) challenge. In NHE rats, reduced attraction by secondary cues (associated with uncertain, rarefying LLL delivery) comes along with little or no activation of dStr and enhanced activation of vStr by MPH. Together, such evidences from NHE rats indicate distinctive roles of ventral (enhanced value given to actual primary reward) and dorsal (lower encoding of repeated stimulus-reward associations into a habit) striatum. In conclusion, the dynamics of reward systems could link an attention deficit with a decreased vulnerability to pathological gambling.

Maturational delay and asymmetric information flow of brain connectivity in SHR model of ADHD revealed by topological analysis of metabolic networks

Attention-deficit hyperactivity disorder (ADHD) is a complex brain development disorder characterized by hyperactivity/impulsivity and inattention. A major hypothesis of ADHD is a lag of maturation, which is supported mainly by anatomical studies evaluating cortical thickness. Here, we analyzed changes of topological characteristics of whole-brain metabolic connectivity in twelve SHR rats selected as ADHD-model rats by confirming behavior abnormalities using the marble burying test, open field test, and delay discounting task and 12 Wistar Kyoto rats as the control group, across development from 4 weeks old (childhood) and 6 weeks old (entry of puberty). A topological approach based on graph filtrations revealed a lag in the strengthening of limbic-cortical/subcortical connections in ADHD-model rats. This in turn related to impaired modularization of memory and reward-motivation associated regions. Using mathematical network analysis techniques such as single linkage hierarchical clustering and volume entropy, we observed left-lateralized connectivity in the ADHD-model rats at 6 weeks old. Our findings supported the maturational delay of metabolic connectivity in the SHR model of ADHD, and also suggested the possibility of impaired and compensative reconfiguration of information flow over the brain network.

The Neuropharmacology of Impulsive Behaviour, an Update

Neuropharmacological interventions in preclinical translational models of impulsivity have tremendously contributed to a better understanding of the neurochemistry and neural basis of impulsive behaviour. In this regard, much progress has been made over the last years, also due to the introduction of novel techniques in behavioural neuroscience such as optogenetics and chemogenetics. In this chapter, we will provide an update of how the behavioural pharmacology field has progressed and built upon existing data since an earlier review we wrote in 2008. To this aim, we will first give a brief background on preclinical translational models of impulsivity. Next, recent interesting evidence of monoaminergic modulation of impulsivity will be highlighted with a focus on the neurotransmitters dopamine and noradrenaline. Finally, we will close the chapter by discussing some novel directions and drug leads in the neuropharmacological modulation of impulsivity.

Social Interaction Test in Home Cage as a Novel and Ethological Measure of Social Behavior in Mice

Sociability is the disposition to interact with one another. Rodents have a rich repertoire of social behaviors and demonstrate strong sociability. Various methods have been established to measure the sociability of rodents in simple and direct ways, which includes reciprocal social interaction, juvenile social play, and three-chamber social tests. There are possible confounding factors while performing some of these tasks, such as aggression, avoidance of interaction by the stimulus mouse, exposure to a new environment, and lengthy procedures. The present study devised a method to complement these shortcomings and measure sociability as a group in the home cage setting, which prevents group-housed mice from isolation or exposure to a new environment. The home cage social test can allow high-throughput screening of social behaviors in a short amount of time. We developed two types of home cage setup: a home cage social target interaction test that measures sociability by putting the wire cage in the center area of the cage and a home cage two-choice sociability and social preference test that measures both sociability or social preference by putting cage racks at opposite sides of the cage. Interestingly, our results showed that the two types of home cage setup that we used in this study can extract abnormal social behaviors in various animal models, similar to the three-chamber assay. Thus, this study establishes a new and effective method to measure sociability or social preference that could be a complementary assay to evaluate the social behavior of mice in various setup conditions.

Females in the forefront: time-based intervention effects on impulsive choice and interval timing in female rats

Impulsive choice has been implicated in substance abuse, gambling, obesity, and other maladaptive behaviors. Deficits in interval timing may increase impulsive choices, and therefore, could serve as an avenue through which suboptimal impulsive choices can be moderated. Temporal interventions have successfully attenuated impulsive choices in male rats, but the efficacy of a temporal intervention has yet to be assessed in female rats. As such, this experiment examined timing and choice behavior in female rats, and evaluated the ability of a temporal intervention to mitigate impulsive choice behavior. The temporal intervention administered in this study was successful in reducing impulsive choices compared to a control group. Results of a temporal bisection task indicated that the temporal intervention increased long responses at the shorter durations. Further, results from the peak trials within the choice task combined with the progressive interval task suggest that the intervention increased sensitivity to delay and enhanced timing confidence. Overall, these results indicate that a temporal intervention can be a successful avenue for reducing impulsive choice behavior in female rats, and could contribute to the development of behavioral interventions to prevent impulsive choice and maladaptive behaviors that can be applied to both sexes.

Sex differences in impulsive and compulsive behaviors: a focus on drug addiction

Sex differences in inhibition and self-regulation at a behavioral level have been widely described. From an evolutionary point of view, the different selection pressures placed on male and female hominids led them to differ in their behavioral strategies that allowed our species to survive during natural selection processes. These differences reflect changes in neural and structural plasticity that might be the core of sex differences, and of the susceptibility towards one psychiatric condition rather than another. The goal of the present review is to summarize current evidence for such a dichotomy in impulsive and compulsive behavior with a focus on drug addiction. Sex-dependent differences in drug abuse and dependence will be examined in the context of pathophysiological regulation of impulse and motivation by neuromodulators (i.e. gonadal hormones) and neurotransmitters (i.e. dopamine). Advances in the understanding of the sex differences in the capability to control impulses and motivational states is key for the determination of efficacious biologically based intervention and prevention strategies for several neuropsychiatric disorders where loss of impulse control and compulsivity are the core symptoms.

Decision-making under risk and ambiguity in low-birth-weight pigs

Low birth weight (LBW) in humans is a risk factor for later cognitive, behavioural and emotional problems. In pigs, LBW is associated with higher mortality, but little is known about consequences for surviving piglets. Alteration in hypothalamic-pituitary-adrenal axis function in LBW pigs suggests altered emotionality, but no behavioural indicators have been studied. Decision-making under uncertain conditions, e.g., risk or ambiguity, is susceptible to emotional influences and may provide a means of assessing long-term effects of LBW in piglets. We tested LBW (N = 8) and normal-birth-weight (NBW; N = 8) male pigs in two decision-making tasks. For decision-making under risk, we developed a simple two-choice probabilistic task, the Pig Gambling Task (PGT), where an 'advantageous' option offered small but frequent rewards and a 'disadvantageous' option offered large but infrequent rewards. The advantageous option offered greater overall gain. For decision-making under ambiguity, we used a Judgement Bias Task (JBT) where pigs were trained to make an active response to 'positive' and 'negative' tone cues (signalling large and small rewards, respectively). Responses to ambiguous tone cues were rated as more or less optimistic. LBW pigs chose the advantageous option more often in later blocks of the PGT, and were scored as less optimistic in the JBT, than NBW pigs. Our findings demonstrate that LBW pigs have developed different behavioural strategies with respect to decision-making. We propose that this is guided by changes in emotionality in LBW piglets, and we provide behavioural evidence of increased negative affect in LBW piglets.

Early life stress in fathers improves behavioural flexibility in their offspring

Traumatic experiences in childhood can alter behavioural responses and increase the risk for psychopathologies across life, not only in the exposed individuals but also in their progeny. In some conditions, such experiences can however be beneficial and facilitate the appraisal of adverse environments later in life. Here we expose newborn mice to unpredictable maternal separation combined with unpredictable maternal stress (MSUS) for 2 weeks and assess the impact on behaviour in the offspring when adult. We show that MSUS in male mice favours goal-directed behaviours and behavioural flexibility in the adult offspring. This effect is accompanied by epigenetic changes involving histone post-translational modifications at the mineralocorticoid receptor (MR) gene and decreased MR expression in the hippocampus. Mimicking these changes pharmacologically in vivo reproduces the behavioural phenotype. These findings highlight the beneficial impact that early adverse experiences can have in adulthood, and the implication of epigenetic modes of gene regulation.

Individual differences in gambling proneness among rats and common marmosets: an automated choice task

Interest is rising for animal modeling of pathological gambling. Using the operant probabilistic-delivery task (PDT), gambling proneness can be evaluated in laboratory animals. Drawing a comparison with rats, this study evaluated the common marmoset (Callithrix jacchus) using a PDT. By nose- or hand-poking, subjects learnt to prefer a large (LLL, 5-6 pellets) over a small (SS, 1-2 pellets) reward and, subsequently, the probability of occurrence of large-reward delivery was decreased progressively to very low levels (from 100% to 17% and 14%). As probability decreased, subjects showed a great versus little shift in preference from LLL to SS reinforcer. Hence, two distinct subpopulations (“non-gambler” versus “gambler”) were differentiated within each species. A proof of the model validity comes from marmosets' reaction to reward-delivery omission. Namely, depending on individual temperament (“gambler” versus “non-gambler”), they showed either persistence (i.e., inadequate pokes towards LLL) or restlessness (i.e., inadequate pokes towards SS), respectively. In conclusion, the marmoset could be a suitable model for preclinical gambling studies. Implementation of the PDT to species other than rats may be relevant for determining its external validity/generalizability and improving its face/construct validity.

A rodent version of the Iowa Gambling Task: 7 years of progress

In the Iowa Gambling Task (IGT) subjects need to find a way to earn money in a context of variable wins and losses, conflicting short-term and long-term pay-off, and uncertainty of outcomes. In 2006, we published the first rodent version of the IGT (r-IGT; Behavior Research Methods 38, 470–478). Here, we discuss emerging ideas on the involvement of different prefrontal-striatal networks in task-progression in the r-IGT, as revealed by our studies thus far. The emotional system, encompassing, among others, the orbitofrontal cortex, infralimbic cortex and nucleus accumbens (shell and core area), may be involved in assessing and anticipating the value of different options in the early stages of the task, i.e., as animals explore and learn task contingencies. The cognitive control system, encompassing, among others, the prelimbic cortex and dorsomedial striatum, may be involved in instrumental goal-directed behavior in later stages of the task, i.e., as behavior toward long-term options is strengthened (reinforced) and behavior toward long-term poor options is weakened (punished). In addition, we suggest two directions for future research: (1) the role of the internal state of the subject in decision-making, and (2) studying differences in task-related costs. Overall, our studies have contributed to understanding the interaction between the emotional system and cognitive control system as crucial to navigating human and non-human animals alike through a world of variable wins and losses, conflicting short-term and long-term pay-offs, and uncertainty of outcomes.

Nonhuman gamblers: lessons from rodents, primates, and robots

The search for neuronal and psychological underpinnings of pathological gambling in humans would benefit from investigating related phenomena also outside of our species. In this paper, we present a survey of studies in three widely different populations of agents, namely rodents, non-human primates, and robots. Each of these populations offers valuable and complementary insights on the topic, as the literature demonstrates. In addition, we highlight the deep and complex connections between relevant results across these different areas of research (i.e., cognitive and computational neuroscience, neuroethology, cognitive primatology, neuropsychiatry, evolutionary robotics), to make the case for a greater degree of methodological integration in future studies on pathological gambling.

Cross-species approaches to pathological gambling: a review targeting sex differences, adolescent vulnerability and ecological validity of research tools

Decision-making plays a pivotal role in daily life as impairments in processes underlying decision-making often lead to an inability to make profitable long-term decisions. As a case in point, pathological gamblers continue gambling despite the fact that this disrupts their personal, professional or financial life. The prevalence of pathological gambling will likely increase in the coming years due to expanding possibilities of on-line gambling through the Internet and increasing liberal attitudes towards gambling. It therefore represents a growing concern for society. Both human and animal studies rapidly advance our knowledge on brain-behaviour processes relevant for understanding normal and pathological gambling behaviour. Here, we review in humans and animals three features of pathological gambling which hitherto have received relatively little attention: (1) sex differences in (the development of) pathological gambling, (2) adolescence as a (putative) sensitive period for (developing) pathological gambling and (3) avenues for improving ecological validity of research tools. Based on these issues we also discuss how research in humans and animals may be brought in line to maximize translational research opportunities.

Neonatal tryptophan depletion and corticosterone supplementation modify emotional responses in adult male mice

The serotonergic system and the hypothalamic-pituitary-adrenal (HPA) axis are crucially involved in the regulation of emotions. Specifically, spontaneous and/or environmentally mediated modulations of the functionality of these systems early in development may favour the onset of depressive- and anxiety-related phenotypes. While the independent contribution of each of these systems to the emergence of abnormal phenotypes has been detailed in clinical and experimental studies, only rarely has their interaction been systematically investigated. Here, we addressed the effects of reduced serotonin and environmental stress during the early stages of postnatal life on emotional regulations in mice. To this aim, we administered, to outbred CD1 mouse dams, during their first week of lactation, a tryptophan deficient diet (T) and corticosterone via drinking water (C; 80μg/ml). Four groups of dams (animal facility rearing, AFR; T treated, T; C treated, C; T and C treated, TC) and their male offspring were used in the study. Maternal care was scored throughout treatment and adult offspring were tested for: anhedonia (progressive ratio schedule); anxiety-related behaviour (approach-avoidance conflict paradigm); BDNF, dopamine and serotonin concentrations in selected brain areas. T, C and TC treatments reduced active maternal care compared to AFR. Adult TC offspring showed significantly increased anxiety- and anhedonia-related behaviours, reduced striatal and increased hypothalamic BDNF and reduced dopamine and serotonin in the prefrontal cortex and their turnover in the hippocampus. Thus, present findings support the view that neonatal variations in the functionality of the serotonergic system and of HPA axis may jointly contribute to induce emotional disturbances in adulthood.

Delay discounting in C57BL/6J and DBA/2J mice: adolescent-limited and life-persistent patterns of impulsivity

Impulsivity is a defining characteristic of adolescence. Compared to adults, for example, adolescents engage in higher rates of drug and alcohol experimentation, risky sexual practices, and criminal activity. Such behavior may reflect reduced sensitivity to long-term consequences of behavior during adolescence. Recently, our lab has attempted to refine mouse procedures to study developmental trends in decision making in the laboratory. In the present experiment, we examined sensitivity to delayed rewards in C57BL/6J (B6) and DBA/2J (D2) mice during adolescence and adulthood using an adaptation of a 2-week delay discounting procedure developed by Adriani and Laviola (2003). During training, mice could choose between a 20- or 100-μl drop of milk delivered after a 1-s delay. During testing, the delay to the large drop of milk was increased from 1 to 100 seconds. As the delay to the larger volume increased, preference shifted to the smaller, more immediate option. In adolescence, both strains showed similar shifts in preference. In contrast, adult B6 mice were less sensitive to increasing delays than were adult D2 mice, who continued to perform much as their adolescent counterparts. A subsequent resistance-to-extinction test ruled out the possibility that the slower change in the adult B6 mice was due to perseverative responding. The present findings suggest that B6 and D2 strains may be differentially suited to uncovering the biological mechanism of short-term and long-term patterns of impulsive behavior.

Rodent versions of the iowa gambling task: opportunities and challenges for the understanding of decision-making

Impaired decision-making is a core problem in several psychiatric disorders including attention-deficit/hyperactivity disorder, schizophrenia, obsessive–compulsive disorder, mania, drug addiction, eating disorders, and substance abuse as well as in chronic pain. To ensure progress in the understanding of the neuropathophysiology of these disorders, animal models with good construct and predictive validity are indispensable. Many human studies aimed at measuring decision-making capacities use the Iowa gambling task (IGT), a task designed to model everyday life choices through a conflict between immediate gratification and long-term outcomes. Recently, new rodent models based on the same principle have been developed to investigate the neurobiological mechanisms underlying IGT-like decision-making on behavioral, neural, and pharmacological levels. The comparative strengths, as well as the similarities and differences between these paradigms are discussed. The contribution of these models to elucidate the neurobehavioral factors that lead to poor decision-making and to the development of better treatments for psychiatric illness is considered, along with important future directions and potential limitations.

Effects of maternal L-tryptophan depletion and corticosterone administration on neurobehavioral adjustments in mouse dams and their adolescent and adult daughters

Major depressive disorder (MDD), a pathology characterized by mood and neurovegetative disturbances, depends on a multi-factorial contribution of individual predisposition (e.g., diminished serotonergic transmission) and environmental factors (e.g., neonatal abuse or neglect). Despite its female-biased prevalence, MDD basic research has mainly focused on male rodents. Most of present models of depression are also devalued due to the fact that they typically address only one of the aforementioned pathogenetic factors. In this paper we first describe the basic principles behind mouse model development and evaluation and then articulate that current models of depression are intrinsically devalued due to poor construct and/or external validity. We then report a first attempt to overcome this limitation through the design of a mouse model in which the genetic and the environmental components of early risk factors for depression are mimicked together. Environmental stress is mimicked through the supplementation of corticosterone in the maternal drinking water while biological predisposition is mimicked through maternal access to an L-tryptophan (the serotonin precursor) deficient diet during the first week of lactation. CD1 dams and their offspring exposed to the L-tryptophan deficient diet (T) and to corticosterone (80mg/l; C) were compared to animal facility reared (AFR) subjects. T and C mice served as intermediate reference groups. Adolescent TC offspring, compared to AFR mice, showed decreased time spent floating in the forced-swim test and increased time spent in the open sectors of an elevated 0-maze. Adult TC offspring showed reduced preference for novelty, decreased breakpoints in the progressive ratio operant procedure and major alterations in central BDNF levels and altered HPA regulation. The route of administration and the possibility to control the independent variables predisposing to depressive-like symptoms disclose novel avenues towards the development of animal models with increased external and construct validity. Furthermore, the observation that, compared to adult subjects, adolescent mice display an opposite profile suggests that peri-pubertal developmental processes may interact with neonatal predispositions to calibrate the adult abnormal phenotype.

Cognitive impulsivity in animal models: role of response time and reinforcing rate in delay intolerance with two-choice operant tasks

Impulsivity, a key symptom of ADHD (attention-deficit hyperactivity disorder), is also common in obsessive-compulsive and addictive disorders. There is rising interest in animal models of inhibitory-control impairment. Adolescent rats were tested daily in the intolerance-to-delay (ID) task (session 25 min, timeout 20 s), involving choice between either immediate small amount of food (SS), or larger amount of food after a delay (LL). The mixed 5-HT(1A/7) agonist (8-OH-DPAT, 0 or 0.060 mg/kg i.p.) was administered acutely just before the last three sessions at highest delays. In addition to the classical choice parameter (percent LL preference), the spontaneous waiting (termed response time, RT) occurring between end of a timeout (TO) and next nose-poke was calculated. The pace between consecutive reinforcer deliveries is given by the mean inter-trial interval (mITI, i.e. TO + RT). Hence, the impact of any given delay may be proportional to this pace and be expressed as delay-equivalent odds, i.e. the extent by which delays are multiples of the mITI. Data revealed that RT/mITI increased sharply from around 15 s/35 s to around 30 s/50 s when imposed delay changed from 30 s to 45 s (i.e. odds from 0.91 to 1.06). This suggests that rats adopted a strategy allowing them to keep in pace with perceived reinforcing rate. The increasing delay constraint directly influenced the length of rats' spontaneous waiting (RT) before next decision. For higher delays, with odds >1, rats shifted to a clear-cut SS preference, which is devoid of any exogenous temporal constraint. A challenge with 8-OH-DPAT (0 or 0.060 mg/kg i.p.) decreased impulsive choice but also increased RT. Thus, tapping onto 5-HT(1A/7) receptors slightly enhanced RT/mITI values, possibly reflecting ability of rats to cope with slower reinforcing rates and/or with delay-cancelled reward paces. In summary, delay-induced states of aversion may arise from the innate tendency to rely on a regular rate of reinforcement. Conversely, a drug-enhanced capacity to cope with delay may involve an internal ability to adjust expectancy about such a reinforcing rate.