Effect of disconnecting the orbital prefrontal cortex from the nucleus accumbens core on inter-temporal choice behaviour: a quantitative analysis

Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity

Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.

Impaired social learning predicts reduced real-life motivation in individuals with depression: A computational fMRI study

BACKGROUND

Major depressive disorder is associated with altered social functioning and impaired learning, on both the behavioural and the neural level. These deficits are likely related, considering that successful social interactions require learning to predict other people's emotional responses. Yet, there is little research examining this relation.

METHODS

Forty-three individuals with high (HD; N = 21) and low (LD; N = 22) depression scores answered questions regarding their real-life social experiences and performed a social learning task during fMRI scanning. As part of the task, subjects learned associations between name cues and rewarding (happy faces) or aversive (fearful faces) social outcomes. Using computational modelling, behavioural and neural correlates of social learning were examined and related to real-life social experiences.

RESULTS

HD participants reported reduced motivation to engage in real-life social activities and demonstrated elevated uncertainty about social outcomes in the task. Moreover, HD subjects displayed altered encoding of social reward predictions in the insula, temporal lobe and parietal lobe. Interestingly, across all subjects, higher task uncertainty and reduced parietal prediction encoding were associated with decreased motivation to engage in real-life social activities.

LIMITATIONS

The size of the included sample was relatively small. The results should thus be regarded as preliminary and replications in larger samples are called for.

CONCLUSION

Taken together, our findings suggest that reduced learning from social outcomes may impair depressed individuals' ability to predict other people's responses in real life, which renders social situations uncertain. This uncertainty, in turn, may contribute to reduced social engagement (motivation) in depression.

Effects of intra-accumbal administration of dopamine and ionotropic glutamate receptor drugs on delay discounting performance in rats

Nucleus accumbens core (NAcc) has been implicated in impulsive choice, as measured in delay discounting. The role of dopamine (DA) in impulsive choice has received considerable attention, whereas glutamate (Glu) has recently been shown to be an important mediator of discounting. However, research has not examined how DA or Glu receptors in NAcc mediate different aspects of delay discounting performance, that is, (a) sensitivity to reinforcer magnitude and (b) sensitivity to delayed reinforcement. Adult male Sprague-Dawley rats were first trained in a delay discounting task, in which the delay to a large magnitude food reinforcer increased across blocks of trials. Following behavioral training, rats received bilateral implantation of guide cannulas into NAcc. Half of the rats (n = 12) received infusions of the DA-selective ligands SKF 38393 (D1-like agonist: 0.03 or 0.1 μg), SCH 23390 (D1-like antagonist: 0.3 or 1.0 μg), quinpirole (D2-like agonist: 0.3 or 1.0 μg), and eticlopride (D2-like antagonist: 0.3 or 1.0 μg). The other half received infusions of the ionotropic Glu ligands MK-801 (NMDA uncompetitive antagonist: 0.3 or 1.0 μg), AP-5 (NMDA competitive antagonist: 0.3 or 1.0 μg), ifenprodil (noncompetitive antagonist at NR2B-containing NMDA receptors: 0.3 or 1.0 μg), and CNQX (AMPA competitive antagonist: 0.2 or 0.5 μg). Results showed that SCH 23390 (0.3 μg) decreased sensitivity to reinforcer magnitude without altering impulsive choice, whereas ifenprodil (1.0 μg) decreased sensitivity to delayed reinforcement (i.e., impulsive choice). The current results show that DA and NMDA receptors in NAcc mediate distinct aspects of discounting performance. (PsycINFO Database Record

Effects of N-methyl-D-aspartate receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure

RATIONALE

The N-methyl-D-aspartate (NMDA) receptor has been recently identified as an important mediator of impulsive choice, as assessed in delay discounting. Although discounting is independently influenced by sensitivity to reinforcer magnitude and delayed reinforcement, few studies have examined how NMDA receptor ligands differentially affect these parameters.

OBJECTIVES

The current study examined the effects of various NMDA receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure.

METHODS

Following behavioral training, rats received treatments of the following NMDA receptor ligands: the uncompetitive antagonists ketamine (0, 1.0, 5.0, or 10.0 mg/kg; i.p.), MK-801 (0, 0.003, 0.01, or 0.03 mg/kg; s.c.), and memantine (0, 2.5, 5.0, or 10.0 mg/kg; i.p.), the competitive antagonist CGS 19755 (0, 5.0, 10.0, or 20.0 mg/kg; s.c.), the non-competitive NR2B subunit-selective antagonist ifenprodil (0, 1.0, 3.0, or 10.0 mg/kg; i.p), and the partial agonist D-cycloserine (0, 3.25, 15.0, or 30.0 mg/kg; s.c.).

RESULTS

When an exponential model was used to describe discounting, CGS 19755 (5.0 mg/kg) increased impulsive choice without altering sensitivity to reinforcer magnitude. Conversely, ketamine (10.0 mg/kg), memantine (5.0 mg/kg), and ifenprodil (10.0 mg/kg) decreased sensitivity to reinforcer magnitude without altering impulsive choice. MK-801 and D-cycloserine did not alter delay-discounting performance, although two-way ANOVA analyses indicated D-cycloserine (15.0 mg/kg) decreased impulsive choice.

CONCLUSIONS

The behavioral changes observed in delay discounting following administration of NMDA receptor antagonists do not always reflect an alteration in impulsive choice. These results emphasize the utility in employing quantitative methods to assess drug effects in delay discounting.

A framework for understanding and advancing intertemporal choice research using rodent models

Intertemporal choices are common and consequential to private and public life. Thus, there is considerable interest in understanding the neural basis of intertemporal decision making. In this minireview, we briefly describe conceptual and psychological perspectives on intertemporal choice and then provide a comprehensive evaluation of the neural structures and signals that comprise the underlying cortico-limbic-striatal circuit. Even though great advances have been made, our understanding of the neurobiology of intertemporal choice is still in its infancy because of the complex and dynamic nature of this form of decision making. We close by briefly discussing recommendations for the future study of intertemporal choice research.

Neural substrates underlying effort, time, and risk-based decision making in motivated behavior

All mobile organisms rely on adaptive motivated behavior to overcome the challenges of living in an environment in which essential resources may be limited. A variety of influences ranging from an organism's environment, experiential history, and physiological state all influence a cost-benefit analysis which allows motivation to energize behavior and direct it toward specific goals. Here we review the substantial amount of research aimed at discovering the interconnected neural circuits which allow organisms to carry-out the cost-benefit computations which allow them to behave in adaptive ways. We specifically focus on how the brain deals with different types of costs, including effort requirements, delays to reward and payoff riskiness. An examination of this broad literature highlights the importance of the extended neural circuits which enable organisms to make decisions about these different types of costs. This involves Cortical Structures, including the Anterior Cingulate Cortex (ACC), the Orbital Frontal Cortex (OFC), the Infralimbic Cortex (IL), and prelimbic Cortex (PL), as well as the Baso-Lateral Amygdala (BLA), the Nucleus Accumbens (NAcc), the Ventral Pallidal (VP), the Sub Thalamic Nucleus (STN) among others. Some regions are involved in multiple aspects of cost-benefit computations while the involvement of other regions is restricted to information relating to specific types of costs.

Neural and neurochemical basis of reinforcement-guided decision making

Decision making is an adaptive behavior that takes into account several internal and external input variables and leads to the choice of a course of action over other available and often competing alternatives. While it has been studied in diverse fields ranging from mathematics, economics, ecology, and ethology to psychology and neuroscience, recent cross talk among perspectives from different fields has yielded novel descriptions of decision processes. Reinforcement-guided decision making models are based on economic and reinforcement learning theories, and their focus is on the maximization of acquired benefit over a defined period of time. Studies based on reinforcement-guided decision making have implicated a large network of neural circuits across the brain. This network includes a wide range of cortical (e.g., orbitofrontal cortex and anterior cingulate cortex) and subcortical (e.g., nucleus accumbens and subthalamic nucleus) brain areas and uses several neurotransmitter systems (e.g., dopaminergic and serotonergic systems) to communicate and process decision-related information. This review discusses distinct as well as overlapping contributions of these networks and neurotransmitter systems to the processing of decision making. We end the review by touching on neural circuitry and neuromodulatory regulation of exploratory decision making.

Acute ethanol effects on neural encoding of reward size and delay in the nucleus accumbens

Acute ethanol administration can cause impulsivity, resulting in increased preference for immediately available rewards over delayed but more valuable alternatives. The manner in which reward size and delay are represented in neural firing is not fully understood, and very little is known about ethanol effects on this encoding. To address this issue, we used in vivo electrophysiology to characterize neural firing in the core of the nucleus accumbens (NAcc) in rats responding for rewards that varied in size or delay after vehicle or ethanol administration. The NAcc is a central element in the circuit that governs decision-making and importantly, promotes choice of delayed rewards. We found that NAcc firing in response to reward-predictive cues encoded anticipated reward value after vehicle administration, but ethanol administration disrupted this encoding, resulting in a loss of discrimination between immediate and delayed rewards in cue-evoked neural responses. In addition, NAcc firing occurring at the time of the operant response (lever pressing) was inversely correlated with behavioral response latency, such that increased firing rates were associated with decreased latencies to lever press. Ethanol administration selectively attenuated this lever press-evoked firing when delayed but not immediate rewards were expected. These effects on neural firing were accompanied by increased behavioral latencies to respond for delayed rewards. Our results suggest that ethanol effects on NAcc cue- and lever press-evoked encoding may contribute to ethanol-induced impulsivity.

The effect of acute morphine on delay discounting in dependent and non-dependent rats

RATIONALE

Chronic opiate use is associated with increased impulsivity in both humans and animals, and previous studies suggest that acute morphine can increase impulsivity in non-dependent rats. However, the extent to which chronic opiate usage modulates the effect of acute morphine is unknown.

METHODS

Rats were trained to delay discount 20 % sucrose solution and then randomly assigned to either a dependent group that received a nightly 30 mg/kg subcutaneous dose of morphine or a non-dependent group that received a nightly saline injection. Once dependence was established, rats were then assigned to one of four acute morphine doses (0, 1.25, 2.5, 5 mg/kg). For 5 days, delay discounting curves were determined 22.5 h after maintenance doses and 1 h after their prescribed acute injections.

RESULTS

In non-dependent rats, 2.5 and 5 mg/kg doses of morphine caused decreased preference for the large reward at all delays. Acute morphine had no effect on discounting curves in dependent rats.

CONCLUSIONS

Morphine dependence can cause tolerance to the effects of acute morphine on delay discounting.

Do the adjusting-delay and increasing-delay tasks measure the same construct: delay discounting?

Delay discounting describes the subjective devaluation of a reward when it is delayed. In animals, the adjusting-delay (AD) and increasing-delay (ID) tasks often are used to assess individual differences in, and drug effects on, delay discounting. No study to date, however, has compared systematically the measures of discounting produced in these tasks. The current study examined the correlation between measures of delay discounting derived from AD and ID procedures. Twenty rats completed 30 sessions under each task (order counterbalanced across rats). Quantitative measures of delay discounting produced by the two tasks were positively correlated, suggesting that the AD and ID tasks measure the same underlying facet of impulsive choice (i.e. individual or conjoint sensitivities to reward delay and magnitude). The measures derived from either task, however, depended on the sequences in which the tasks were experienced. That is, pre-exposure to one task decreased discounting of delayed rewards in the second task. Consistent with other published findings, exposure to delayed consequences during the initial discounting assessment might explain this effect. Despite the observed correlation between ID and AD indifference delays, we suggest that the ID procedure might be a more appropriate procedure for pharmacological studies.

Nucleus accumbens core and shell inactivation differentially affects impulsive behaviours in rats

Impulsivity is a multifactorial phenomenon, determined by deficits in decision-making (impulsive choice) and impulse control (impulsive action). Recent findings indicate that impulsive behaviour is not only top-down controlled by cortical areas, but also modulated at subcortical level. The nucleus accumbens (NAc) might be a key substrate in cortico-limbic-striatal circuits involved in impulsive behaviour. Dissociable effects of the NAc subregions in various behavioural paradigms point to a potential functional distinction between NAc core and shell concerning different types of impulsivity. The present study used reversible inactivation of the rats' NAc core and shell via bilateral microinfusion of the GABAA receptor agonist muscimol (0.05μg/0.3μl) and fluorophore-conjugated muscimol (FCM, 0.27μg/0.3μl) in order to study their contribution to different aspects of impulse control in a 5-choice serial reaction time task (5-CSRTT) and impulsive choice in a delay-based decision-making T-maze task. Acute inactivation of NAc core as well as shell by muscimol increased impulsive choice, with higher impairments of the rats' waiting capacity in the T-maze following core injections compared to shell. Intra-NAc shell infusion of muscimol also induced specific impulse control deficits in the 5-CSRTT, while deactivation of the core caused severe general impairments in task performance. FCM did not affect animal behaviour. Our findings reveal clear involvement of NAc shell in both forms of impulsivity. Both subareas play a key role in the regulation of impulsive decision-making, but show functional dichotomy regarding impulse control with the core being more implicated in motivational and motor aspects.

Recent Insights into the Neurobiology of Impulsivity

Impulsivity is associated with various psychopathologies, and elevated impulsivity is typically disadvantageous. This manuscript reviews recent investigations into the neurobiology of impulsivity using human imaging techniques and animal models. Both human imaging and preclinical pharmacological manipulations have yielded important insights into the neurobiological underpinnings of impulsivity. A more thorough understanding of the complex neurobiology underlying aspects of impulsivity may provide insight into new treatment options that target elevated impulsivity and psychopathologies such as addictions.

Intake-dependent effects of cocaine self-administration on impulsive choice in a delay discounting task

Cocaine use is associated with high levels of impulsive choice (greater discounting of delayed rewards) in humans, but the cause/effect relationships between cocaine use and impulsive choice are not fully understood. In previous work, we found that both experimenter- and self-administration of fixed quantities of cocaine caused lasting increases in impulsive choice in rats. The present study extended these findings by taking into account baseline impulsive choice prior to self-administration and by allowing rats free access to cocaine. Male Long-Evans rats were trained in a delay discounting task in which they made discrete-trial choices between small immediate and large delayed food rewards. Half of the rats were then implanted with intravenous catheters and, following recovery, allowed to self-administer cocaine HCl (1.0 mg/kg/infusion) in 6-hr sessions over 14 days. Control rats orally self-administered a sucrose solution under similar conditions. Upon completion of self-administration, rats remained abstinent for 3 weeks before retesting in the delay discounting task. Cocaine and control groups did not differ prior to self-administration, but afterward, the cocaine group showed greater impulsive choice (fewer choices of large, delayed rewards) than controls. Additional analyses revealed that the effects of cocaine on impulsive choice were intake-dependent; rats classified as "low intake" did not differ from controls, whereas rats classified as "high intake" were significantly more impulsive than both controls and their precocaine baseline. These findings are consistent with the idea that cocaine-induced, pharmacologically based neural adaptations promote the development of impulsive decision making.

Partial inactivation of nucleus accumbens core decreases delay discounting in rats without affecting sensitivity to delay or magnitude

Increased preference for smaller, sooner rewards (delay discounting) is associated with several behavioral disorders, including ADHD and substance use disorders. However, delay discounting is a complex cognitive process and the relationship is unclear between the pathophysiology of the disorders and the component processes underlying delay discounting, including sensitivity to reinforcer delay and sensitivity to reinforcer magnitude. To investigate these processes, male Long Evans rats were trained in one of three tasks measuring sensitivity to delay, sensitivity to magnitude, or both (typical delay discounting task). After learning the task, animals were implanted with bilateral cannulae into either the nucleus accumbens core (AcbC) or the lateral orbitofrontal cortex (lOFC), both of which have been implicated in delay discounting. Upon recovering from the surgery, a baclofen/muscimol cocktail was infused to temporarily inactivate each of these two regions and task performance was assessed. Unlike previous studies showing that lesions of the AcbC increased delay discounting, partial inactivation of the AcbC decreased delay discounting, although it had no effects on the tasks independently assessing either sensitivity to delay or magnitude. The effects of AcbC inactivation were larger in animals that had low levels of delay discounting at baseline. Inactivation of the lOFC had no effects on behavior in any task. These findings suggest that the AcbC may act to promote impulsive choice in individuals with low impulsivity. Furthermore, the data suggest that the AcbC is able to modulate delay and magnitude sensitivity together, but not either of the two in isolation.

Obesity and addiction: neurobiological overlaps

Drug addiction and obesity appear to share several properties. Both can be defined as disorders in which the saliency of a specific type of reward (food or drug) becomes exaggerated relative to, and at the expense of others rewards. Both drugs and food have powerful reinforcing effects, which are in part mediated by abrupt dopamine increases in the brain reward centres. The abrupt dopamine increases, in vulnerable individuals, can override the brain's homeostatic control mechanisms. These parallels have generated interest in understanding the shared vulnerabilities between addiction and obesity. Predictably, they also engendered a heated debate. Specifically, brain imaging studies are beginning to uncover common features between these two conditions and delineate some of the overlapping brain circuits whose dysfunctions may underlie the observed deficits. The combined results suggest that both obese and drug-addicted individuals suffer from impairments in dopaminergic pathways that regulate neuronal systems associated not only with reward sensitivity and incentive motivation, but also with conditioning, self-control, stress reactivity and interoceptive awareness. In parallel, studies are also delineating differences between them that centre on the key role that peripheral signals involved with homeostatic control exert on food intake. Here, we focus on the shared neurobiological substrates of obesity and addiction.

A review on the relationship between testosterone and life-course persistent antisocial behavior

Life-course persistent antisocial behavior is 10 to 14 times more prevalent in males and it has been suggested that testosterone levels could account for this gender bias. Preliminary studies with measures of fetal testosterone find inconsistent associations with antisocial behavior, especially studies that use the 2D:4D ratio as a proxy for fetal testosterone. However, circulating testosterone consistently shows positive associations with antisocial behaviors throughout childhood, adolescence, and adulthood, particularly in males. It is suggested that high fetal/circulating testosterone interactively influence the maturation and functionality of mesolimbic dopaminergic circuitry, right orbitofrontal cortex, and cortico-subcortical connectivity, resulting in a strong reward motivation, low social sensitivity, and dampened regulation of strong motivational/emotional processes. The link between these testosterone induced endophenotypes and actual display of antisocial behavior is strongly modulated by different social (e.g., social rejection, low SES) and genetic (e.g., MAOA, 5HTT) risk factors that can disturb socio-, psycho-, and biological development and interact with testosterone in shaping behavior. When these additional risk factors are present, the testosterone induced endophenotypes may increase the risk for a chronic antisocial lifestyle. However, behavioral endophenotypes induced by testosterone can also predispose towards socially adaptive traits such as a strong achievement motivation, leadership, fair bargaining behaviors, and social assertiveness. These adaptive traits are more likely to emerge when the high testosterone individual has positive social experiences that promote prosocial behaviors such as strong and secure attachments with his caregivers, affiliation with prosocial peers, and sufficient socioeconomic resources. A theoretical model is presented, various hypotheses are examined, and future venues for research are discussed.

The effect of morphine dependence on impulsive choice in rats

RATIONALE

In the human opiate-dependent population, the most consistently reported deficit in executive functioning is impulsivity. Previous research has shown that acute and chronic exposure to drugs of abuse can increase impulsive choice; however, the extent to which opiate dependence contributes to increased impulsivity has not been examined. We report here the effects of morphine dependence on rats' delay discounting (DD) of a sucrose reward.

METHODS

We assigned rats randomly to either a dependent group that received a nightly 30 mg/kg subcutaneous dose of morphine or a morphine-naive group that received a nightly saline injection. DD of a sucrose reward was examined in rats prior to initiation of the dosing regimen, 22.5 h after the daily maintenance dose, and after a 14-day abstinence period.

RESULTS

The groups did not differ at baseline, but rats showed accelerated DD while dependent on morphine. After withdrawal from morphine, DD in previously dependent rats was not significantly different from that of naive rats. Since dependent rats also showed reduced motivation to acquire the sucrose reinforcer, we performed a separate experiment to test whether such a decrease in motivation could cause an increase in impulsivity. We found that food-deprived rats switched to a free-feeding diet did not differ in DD from rats maintained at 85 % of free-feeding weight.

CONCLUSIONS

An increase in impulsivity can result from physical dependence on morphine and cannot be attributed to changes in motivation to acquire sucrose-reinforced responses.

Chronic corticosterone exposure during adolescence reduces impulsive action but increases impulsive choice and sensitivity to yohimbine in male Sprague-Dawley rats

Chronic stress during adolescence is associated with an increased risk for alcoholism and addictive disorders. Addiction is also associated with increased impulsivity, and stress during adolescence could alter cortical circuits responsible for response inhibition. Therefore, the present study determined the effect of chronic exposure to the stress hormone corticosterone (CORT) during adolescence on tests of impulsivity in adulthood and examined possible biochemical mechanisms. Male Sprague-Dawley rats were exposed to CORT by their drinking water during adolescence (post-natal day 30-50). The rats were then tested in adulthood to assess behavior on the 5-choice serial reaction time task (5CSRTT), stop-signal reaction time task (SSRTT), and the delay-discounting task, which differentially assess attention, impulsive action, and impulsive choice. Yohimbine-induced impulsivity on the 5CSRTT and biochemical analysis of the lateral orbital frontal cortex (lOFC) was also assessed owing to the ability of yohimbine to activate the hypothalamic-pituitary-adrenal axis and influence impulsivity. Adolescent CORT-treated rats were found to behave largely like controls on the 5CSRTT, but did show reduced premature responses when the intertrial interval was increased. Nevertheless, the CORT-treated rats tended to have more yohimbine-induced impulsive responses at low doses on this task, which was not found to be due to increased pCREB in the lOFC, but could be related to a higher expression/activity of the AMPA receptor subunit GluR1. Adolescent CORT-treated rats performed more accurately on the SSRTT, but showed greater impulsivity on the delay-discounting task, as indicated by steeper discounting functions. Therefore, adolescent CORT exposure reduced impulsive action but increased impulsive choice, indicating that chronic stress hormone exposure in adolescence can have long-term consequences on behavior.

Separate prefrontal-subcortical circuits mediate different components of risk-based decision making

Choosing between smaller, assured rewards or larger, uncertain ones requires reconciliation of competing biases toward more certain or riskier options. We used disconnection and neuroanatomical techniques to reveal that separate, yet interconnected, neural pathways linking the medial prefrontal cortex (PFC), the basolateral amygdala (BLA), and nucleus accumbens (NAc) contribute to these different decision biases in rats. Disrupting communication between the BLA and NAc revealed that this subcortical circuit biases choice toward larger, uncertain rewards on a probabilistic discounting task. In contrast, disconnections between the BLA and PFC increased choice of the Large/Risky option. PFC-NAc disconnections did not affect choice but did increase choice latencies and trial omissions. Neuroanatomical studies confirmed that projection pathways carrying axons from BLA-to-PFC transverse a distinctly different route relative to PFC-to-BLA pathways (via the ventrolateral amydalofugal pathway and ventromedial internal capsule, respectively). We exploited these dissociable axonal pathways to selectively disrupt bottom-up and top-down communication between the BLA and PFC. Subsequent disconnection studies revealed that disruption of top-down (but not bottom-up) information transfer between the medial PFC and BLA increased choice of the larger, riskier option, suggesting that this circuit facilitates tracking of actions and outcomes to temper urges for riskier rewards as they become less profitable. These findings provide novel insight into the dynamic competition between these cortical/subcortical circuits that shape our decision biases and underlie conflicting urges when evaluating options that vary in terms of potential risks and rewards.

Nucleus accumbens and delay discounting in rats: evidence from a new quantitative protocol for analysing inter-temporal choice

RATIONALE

There is evidence that the core of the nucleus accumbens (AcbC) is involved in inter-temporal choice behaviour.

OBJECTIVE

A new behavioural protocol was used to examine the effect of destruction of the AcbC on delay discounting in inter-temporal choice schedules in rats.

METHOD

Rats with excitotoxic lesions of the AcbC or sham lesions made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately and a larger reinforcer (B) that was delivered after a delay which increased or decreased depending on the subject's choices. In two phases of the experiment, reinforcer sizes were selected which enabled theoretical parameters expressing delay discounting and sensitivity to reinforcer size to be estimated from the ratio of the indifference delays (i.e. the quasi-stable values of the adjusting delay seen after extended training) obtained in the two phases.

RESULTS

In both groups, indifference delays were shorter when the sizes of A and B were 14 and 25 μl than when they were 25 and 100 μl of a 0.6 M sucrose solution. Indifference delays were shorter in AcbC-lesioned than in sham-lesioned rats. Estimates of delay discounting rate based on the ratio of the indifference delays were lower in the AcbC-lesioned than in the sham-lesioned rats. The size sensitivity parameter did not differ between the groups. Adjusting delays in successive blocks of trials were analysed using Fourier transform. The period corresponding to the dominant frequency of the power spectrum and power within the dominant frequency band did not differ between the groups.

CONCLUSIONS

Destruction of the AcbC increased the rate of delay discounting.

Effects of selective dopaminergic compounds on a delay-discounting task

Impulsivity is widely regarded as a multidimensional trait that encompasses two or more distinct patterns of behavior, and dopaminergic systems are implicated in the expression of impulsive behavior in both humans and animal subjects. Impulsive choice, or the tendency to choose rewards associated with relatively little or no delay, has been extensively studied in humans and animal subjects using delay-discounting tasks. Here, delay-discounting procedures were used to assess the effects of receptor-selective dopaminergic agonists, antagonists, and dopamine transporter ligands on choices of immediate versus delayed sucrose pellets. The effects of d-amphetamine, GBR 12909, apomorphine, SKF 81297, sumanirole, pramipexole, ABT-724, SCH 23390, L-741,626, PG01037, and L-745,870 were assessed in 24 Sprague-Dawley rats. The only drugs to affect impulsive choice selectively without altering undelayed choice were the D1-like antagonist, SCH 23390 (0.01 mg/kg), and the D4 partial agonist, ABT-724 (3.2 mg/kg), which both increased impulsive choice. The shared effects of these compounds may be explained by their localization within the prefrontal cortex on different groups of neurons. None of the selective agonists and antagonists tested reduced impulsive choice, so further research is needed to determine if direct dopaminergic agonists or antagonists may be therapeutically useful in the treatment of impulse-control disorders.

Acute nicotine increases both impulsive choice and behavioural disinhibition in rats

RATIONALE

Heavy smokers exhibit greater levels of impulsive choice and behavioural disinhibition than non-smokers. To date, however, the relationship between nicotine use and differing dimensions of impulsivity has not been systematically assessed.

OBJECTIVES

A series of studies was designed to assess the acute dose-response effects of nicotine and the nicotinic receptor antagonist mecamylamine alone, and in combination with nicotine, on impulsive choice and behavioural disinhibition in rats.

METHODS

Separate groups of rats were trained on a symmetrically reinforced go/no-go task to measure levels of disinhibition and a systematic delayed reward task to measure levels of impulsive choice. Once trained, all animals in each task were treated acutely with nicotine (0.125, 0.25, 0.5 and 1.0 mg/kg), mecamylamine (0.1, 0.3 and 1.0 mg/kg) and varying doses of mecamylamine (0.1, 0.3 and 1.0 mg/kg) prior to nicotine (0.5 mg/kg). An additional experiment assessed the effects of alterations in primary motivation (presatiation and fasting) on performance in both tasks.

RESULTS

Acute nicotine increased both impulsive choice and behavioural disinhibition, effects that were blocked by pre-treatment with mecamylamine. Mecamylamine when administered alone did not alter impulsive behaviour. The lack of effect of presatiation on performance measures suggests that the observed nicotine-induced impulsivity cannot be attributed to the anorectic activity of the compound.

CONCLUSIONS

Present findings support the hypothesis that heightened impulsivity in smokers may in part be a consequence of the direct acute effects of nicotine. As such, drug-induced changes in impulsivity may play a critical role in the transition to and maintenance of nicotine dependence.

Transitional and steady-state choice behavior under an adjusting-delay schedule

Twelve rats made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately after a response and a larger reinforcer (B) that was delivered after a delay which increased or decreased by 20% depending on the subject's choices in successive blocks of trials. In two phases of the experiment (100 sessions and 40 sessions), reinforcer sizes were selected which enabled theoretical parameters expressing the rate of delay discounting and sensitivity to reinforcer size to be estimated from the ratio of the indifference delays obtained in the two phases. Indifference delays, calculated from adjusting delays in the last 10 sessions of each phase, were shorter when the sizes of A and B were 14 and 25 µl of a 0.6 M sucrose solution than when they were 25 and 100 µl of the same solution. The ratio of the indifference delays was significantly smaller than that predicted on the basis of an assumed linear relation between reinforcer size and instantaneous reinforcer value, consistent with a previous proposal that this relation may be hyperbolic in form. Estimates of the rate of delay discounting based on the ratio of the two indifference delays (mean, 0.08 s(-1)) were similar to values obtained previously using different intertemporal choice protocols. Estimates of the size-sensitivity parameter (mean 113 µl) were similar to estimates recently derived from performance on progressive-ratio schedules. In both phases of the experiment, adjusting delays in successive blocks of trials were analyzed using the Fourier transform. The power spectrum obtained from individual rats had a dominant frequency that corresponded to a period of oscillation of the adjusting delay between 30 and 100 trial blocks (mean, 78). Power in the dominant frequency band was highest in the early sessions of the first phase and declined with extended training. It is suggested that this experimental protocol may have utility in neurobehavioral studies of intertemporal choice.

Translating cognition from animals to humans

Many clinical disorders, whether neurological (e.g. Alzheimer's disease) or neuropsychiatric (e.g. schizophrenia and depression), exhibit cognitive symptoms that require pharmacological treatment. Cognition is multi-faceted and includes processes of perception, attention, working memory, long-term memory, executive function, language and social cognition. This article reviews how it is feasible to model many aspects of human cognition with the use of appropriate animal models and associated techniques, including the use of computer controlled tests (e.g. touch-screens), for optimising translation of experimental research to the clinic. When investigating clinical disorders, test batteries should aim to profile cognitive function in order to determine which aspects are impaired and which are preserved. In this review we have paid particular attention to the validation of translational methods; this may be done through the application of common theoretical principles, by comparing the effects of psychological manipulations and, wherever feasible, with the demonstration of homologous neural circuitry or equivalent pharmacological actions in the animal and human paradigms. Of particular importance is the use of 'back-translation' to ensure that the animal model has validity, for example, in predicting the effects of therapeutic drugs already found in human studies. It is made clear that the choice of appropriate behavioral tests is an important element of animal models of neuropsychiatric or neurological disorder; however, of course it is also important to select appropriate manipulations, whether genetic, neurodevelopmental, neurotoxic, or pharmacological, for simulating the neural substrates relevant to the disorders that lead to predictable behavioral and cognitive impairments, for optimising the testing of candidate compounds.

Choice between reinforcer delays versus choice between reinforcer magnitudes: differential Fos expression in the orbital prefrontal cortex and nucleus accumbens core

Lesions of the orbital prefrontal cortex (OPFC) and the nucleus accumbens core (AcbC) can disrupt performance in inter-temporal choice tasks, possibly by increasing the organism's sensitivity to delay and/or magnitude of reinforcement. This experiment examined whether exposure to an inter-temporal choice would induce neuronal activation in these areas, as indicated by enhanced expression of the Fos protein. Twelve rats were trained to press levers A and B under an adjusting-delay schedule in which a response on A delivered 50 microl of a sucrose reinforcer after 2 or 18s, whereas a response on B delivered the same reinforcer after a delay that was adjusted in accordance with the rat's choices. Another 12 rats were trained under a similar schedule in which a response on A delivered an immediate reinforcer of size 20 or 180 microl, whereas a response on B delivered an immediate reinforcer whose size was adjusted in accordance with the rat's choices. A third group received training under a schedule that did not entail variation of reinforcer size or delay, or choice between reinforcers, and a control group underwent food restriction without behavioural training. Exposure to the adjusting-delay schedule was associated with enhanced Fos expression in both the OPFC and AcbC, whereas exposure to the adjusting-magnitude schedule was associated with enhanced Fos expression in the OPFC but not the AcbC, compared to the control group. The results are consistent with previous findings that implicated the AcbC and OPFC in delay discounting, and the OPFC in sensitivity to reinforcer size.

Quantitative analysis of the effect of lesions of the subthalamic nucleus on intertemporal choice: further evidence for enhancement of the incentive value of food reinforcers

Recent evidence suggests that the subthalamic nucleus (STN) is involved in regulating the incentive value of food reinforcers. The objective of this study was to examine the effect of lesions of the STN on intertemporal choice (choice between reinforcers differing in size and delay). Rats with bilateral quinolinic acid-induced lesions of the STN (n = 15) or sham lesions (n = 14) were trained in a discrete-trials progressive delay schedule to press levers A and B for a sucrose solution. Responses on A delivered 50 microl of the solution after a delay d(A); responses on B delivered 100 microl after a delay d(B). d(B) increased across blocks of trials; d(A) was manipulated across phases of the experiment. Indifference delay, d(B(50)) (value of d(B) corresponding to 50% choice of B), was estimated for each rat in each phase, and linear indifference functions (d(B(50)) vs. d(A)) were derived. The STN-lesioned group showed a flatter slope of the indifference function (implying higher instantaneous reinforcer values) than the sham-lesioned group; the intercepts did not differ between the groups. The results agree with recent evidence for a role of the STN in incentive value. Unlike some earlier studies, these results do not indicate a role of the STN in delay discounting.

Effects of lesions of the nucleus accumbens core on inter-temporal choice: further observations with an adjusting-delay procedure

Previous experiments using progressive-delay schedules showed that destruction of the nucleus accumbens core (AcbC) altered rats' choice between food reinforcers differing in size and delay. Application of a quantitative model of inter-temporal choice suggested that lesions of the AcbC increase the delay-dependent degradation of reinforcer value (delay discounting) without altering instantaneous reinforcer value. This experiment examined the effect of lesions of the AcbC on inter-temporal choice using an adjusting-delay schedule. Rats received excitotoxin-induced lesions of the AcbC or sham lesions. They were trained to press levers A and B for food-pellet reinforcers in an adjusting-delay schedule in which the delay to the larger reinforcer, d(B), varied in accordance with the rats' choices between the two levers. In two experimental conditions, the reinforcers associated with levers A and B were 1 vs. 4 and 2 vs. 4 pellets. The AcbC-lesioned group showed shorter indifference delays to reinforcer B (d(B(50))) than the sham-lesioned group under both conditions. In confirmation of a prediction derived from the model of inter-temporal choice, the ratio of the indifference delays from the two conditions did not differ between the groups. Analysis of the cyclical changes in d(B) by Fourier transform showed that the period of oscillation and power within the dominant frequency band did not differ between the groups, suggesting that the lesion did not disrupt the rats' ability to detect short-term changes in delay of reinforcement. The results are consistent with previous findings that indicate a role for the AcbC in delay discounting.