Effect of orbitofrontal cortex lesions on temporal discounting in rats

Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity

Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.

Not all discounts are created equal: Regional activity and brain networks in temporal and effort discounting

Reward outcomes associated with costs like time delay and effort investment are generally discounted in decision-making. Standard economic models predict rewards associated with different types of costs are devalued in a similar manner. However, our review of rodent lesion studies indicated partial dissociations between brain regions supporting temporal- and effort-based decision-making. Another debate is whether options involving low and high costs are processed in different brain substrates (dual-system) or in the same regions (single-system). This research addressed these issues using coordinate-based, connectivity-based, and activation network-based meta-analyses to identify overlapping and separable neural systems supporting temporal (39 studies) and effort (20 studies) discounting. Coordinate-based activation likelihood estimation and resting-state connectivity analyses showed immediate-small reward and delayed-large reward choices engaged distinct regions with unique connectivity profiles, but their activation network mapping was found to engage the default mode network. For effort discounting, salience and sensorimotor networks supported low-effort choices, while the frontoparietal network supported high-effort choices. There was little overlap between the temporal and effort networks. Our findings underscore the importance of differentiating different types of costs in decision-making and understanding discounting at both regional and network levels.

Transcranial direct current stimulation (tDCS) over the orbitofrontal cortex reduces delay discounting

Delay discounting (DD) is a quantifiable psychological phenomenon that regulates decision-making. Nevertheless, the neural substrates of DD and its relationship with other cognitive domains are not well understood. The orbitofrontal cortex (OFC) is a potential candidate for supporting the expression of DD, but due to its wide involvement in several psychological functions and neural networks, its central role remains elusive. In this study, healthy subjects underwent transcranial direct current stimulation (tDCS) while performing an intertemporal choice task for the quantification of DD and a working memory task. To selectively engage the OFC, two electrode configurations have been tested, namely, anodal Fp1-cathodal Fp2 and cathodal Fp1-anodal Fp2. Our results show that stimulation of the OFC reduces DD, independently from electrode configuration. In addition, no relationship was found between DD measures and either working memory performance or baseline impulsivity assessed through established tests. Our work will direct future investigations aimed at unveiling the specific neural mechanisms underlying the involvement of the OFC in DD, and at testing the efficacy of OFC tDCS in reducing DD in psychological conditions where this phenomenon has been strongly implicated, such as addiction and eating disorders.

GABAB receptors in prelimbic cortex and basolateral amygdala differentially influence intertemporal decision making and decline with age

The ability to decide adaptively between immediate vs. delayed gratification (intertemporal choice) is critical for well-being and is associated with a range of factors that influence quality of life. In contrast to young adults, many older adults show enhanced preference for delayed gratification; however, the neural mechanisms underlying this age difference in intertemporal choice are largely un-studied. Changes in signaling through GABA_B receptors (GABA_BRs) mediate several age-associated differences in cognitive processes linked to intertemporal choice. The current study used a rat model to determine how GABA_BRs in two brain regions known to regulate intertemporal choice (prelimbic cortex; PrL and basolateral amygdala; BLA) contribute to age differences in this form of decision making in male rats. As in humans, aged rats showed enhanced preference for large, delayed over small, immediate rewards during performance in an intertemporal choice task in operant test chambers. Activation of PrL GABA_BRs via microinfusion of the agonist baclofen increased choice of large, delayed rewards in young adult rats but did not influence choice in aged rats. Conversely, infusion of baclofen into the BLA strongly reduced choice of large, delayed rewards in both young adult and aged rats. Aged rats further showed a significant reduction in expression of GABA_BR1 subunit isoforms in the prefrontal cortex, a discovery that is consonant with the null effect of intra-PrL baclofen on intertemporal choice in aged rats. In contrast, expression of GABA_BR subunits was generally conserved with age in the BLA. Jointly, these findings elucidate a role for GABA_BRs in intertemporal choice and identify fundamental features of brain maturation and aging that mediate an improved ability to delay gratification.

Mapping Large-Scale Networks Associated with Action, Behavioral Inhibition and Impulsivity

A key aspect of behavioral inhibition is the ability to wait before acting. Failures in this form of inhibition result in impulsivity and are commonly observed in various neuropsychiatric disorders. Prior evidence has implicated medial frontal cortex, motor cortex, orbitofrontal cortex (OFC), and ventral striatum in various aspects of inhibition. Here, using distributed recordings of brain activity [with local-field potentials (LFPs)] in rodents, we identified oscillatory patterns of activity linked with action and inhibition. Low-frequency (δ) activity within motor and premotor circuits was observed in two distinct networks, the first involved in cued, sensory-based responses and the second more generally in both cued and delayed actions. By contrast, θ activity within prefrontal and premotor regions (medial frontal cortex, OFC, ventral striatum, and premotor cortex) was linked with inhibition. Connectivity at θ frequencies was observed within this network of brain regions. Interestingly, greater connectivity between primary motor cortex (M1) and other motor regions was linked with greater impulsivity, whereas greater connectivity between M1 and inhibitory brain regions (OFC, ventral striatum) was linked with improved inhibition and diminished impulsivity. We observed similar patterns of activity on a parallel task in humans: low-frequency activity in sensorimotor cortex linked with action, θ activity in OFC/ventral prefrontal cortex (PFC) linked with inhibition. Thus, we show that δ and θ oscillations form distinct large-scale networks associated with action and inhibition, respectively.

Neuroanatomy of the vmPFC and dlPFC Predicts Individual Differences in Cognitive Regulation During Dietary Self-Control Across Regulation Strategies

Making healthy food choices is challenging for many people. Individuals differ greatly in their ability to follow health goals in the face of temptation, but it is unclear what underlies such differences. Using voxel-based morphometry, we investigated in healthy humans (i.e., men and women) the links between structural variation in gray matter volume and individuals' level of success in shifting toward healthier food choices. We combined MRI and choice data into a joint dataset by pooling across three independent studies that used a task prompting participants to explicitly focus on the healthiness of food items before making their food choices. Within this dataset, we found that individual differences in gray matter volume in the ventromedial prefrontal cortex (vmPFC) and dorsolateral prefrontal cortex (dlPFC) predicted regulatory success. We extended and confirmed these initial findings by predicting regulatory success out of sample and across tasks in a second dataset requiring participants to apply a different regulation strategy that entailed distancing from cravings for unhealthy, appetitive foods. Our findings suggest that neuroanatomical markers in the vmPFC and dlPFC generalized to different forms of dietary regulation strategies across participant groups. They provide novel evidence that structural differences in neuroanatomy of two key regions for valuation and its control, the vmPFC and dlPFC, predict an individual's ability to exert control in dietary choices.SIGNIFICANCE STATEMENT Dieting involves regulating food choices to eat healthier foods and fewer unhealthy foods. People differ dramatically in their ability to achieve or maintain this regulation, but it is unclear why. Here, we show that individuals with more gray matter volume in the dorsolateral and ventromedial prefrontal cortex are better at exercising dietary self-control. This relationship was observed across four different studies examining two different forms of dietary self-regulation, suggesting that neuroanatomical differences in the ventromedial prefrontal cortex and dorsolateral prefrontal cortex may represent a general marker for self-control abilities. These results identify candidate neuroanatomical markers for dieting success and failure, and suggest potential targets for therapies aimed at preventing or treating obesity and related eating disorders.

Differential Encoding of Time by Prefrontal and Striatal Network Dynamics

Telling time is fundamental to many forms of learning and behavior, including the anticipation of rewarding events. Although the neural mechanisms underlying timing remain unknown, computational models have proposed that the brain represents time in the dynamics of neural networks. Consistent with this hypothesis, changing patterns of neural activity dynamically in a number of brain areas-including the striatum and cortex-has been shown to encode elapsed time. To date, however, no studies have explicitly quantified and contrasted how well different areas encode time by recording large numbers of units simultaneously from more than one area. Here, we performed large-scale extracellular recordings in the striatum and orbitofrontal cortex of mice that learned the temporal relationship between a stimulus and a reward and reported their response with anticipatory licking. We used a machine-learning algorithm to quantify how well populations of neurons encoded elapsed time from stimulus onset. Both the striatal and cortical networks encoded time, but the striatal network outperformed the orbitofrontal cortex, a finding replicated both in simultaneously and nonsimultaneously recorded corticostriatal datasets. The striatal network was also more reliable in predicting when the animals would lick up to ∼1 s before the actual lick occurred. Our results are consistent with the hypothesis that temporal information is encoded in a widely distributed manner throughout multiple brain areas, but that the striatum may have a privileged role in timing because it has a more accurate "clock" as it integrates information across multiple cortical areas.

SIGNIFICANCE STATEMENT

The neural representation of time is thought to be distributed across multiple functionally specialized brain structures, including the striatum and cortex. However, until now, the neural code for time has not been compared quantitatively between these areas. Here, we performed large-scale recordings in the striatum and orbitofrontal cortex of mice trained on a stimulus-reward association task involving a delay period and used a machine-learning algorithm to quantify how well populations of simultaneously recorded neurons encoded elapsed time from stimulus onset. We found that, although both areas encoded time, the striatum consistently outperformed the orbitofrontal cortex. These results suggest that the striatum may refine the code for time by integrating information from multiple inputs.

A framework for understanding and advancing intertemporal choice research using rodent models

Intertemporal choices are common and consequential to private and public life. Thus, there is considerable interest in understanding the neural basis of intertemporal decision making. In this minireview, we briefly describe conceptual and psychological perspectives on intertemporal choice and then provide a comprehensive evaluation of the neural structures and signals that comprise the underlying cortico-limbic-striatal circuit. Even though great advances have been made, our understanding of the neurobiology of intertemporal choice is still in its infancy because of the complex and dynamic nature of this form of decision making. We close by briefly discussing recommendations for the future study of intertemporal choice research.

[The role of the orbitofrontal cortex in delayed reinforcement choice in rats]

Previous studies have reported that lesions of the orbitofrontal cortex (OFC) in rats induce impulsive choices in delayed reinforcement tasks. However, some studies have suggested that the OFC is not related to impulsivity but instead to compulsivity. In this study, we investigated the effects of OFC lesions on choice in a T-maze. First, 14 rats were trained to discriminate spatially between a high-reward arm with a delay of 15 seconds and a low-reward arm without a delay. The high-reward arm contained 10 food pellets, whereas the low-reward arm contained only one pellet. In the presurgery test, all rats chose the high-reward arm in most trials. In the postsurgery test, both OFC lesioned (n = 7) and control (sham-lesioned and intact; n = 7) rats continued to choose the high-reward arm in most trials. Following the postsurgery test, the high- and low-reward arms were reversed. In the reversal test, OFC lesioned rats made significantly fewer high-reward choices than did control rats. These results indicate that OFC lesions induced compulsive choices rather than impulsive choices.

Individual differences in impulsive action and dopamine transporter function in rat orbitofrontal cortex

Impulsivity, which can be subdivided into impulsive action and impulsive choice, is implicated as a factor underlying drug abuse vulnerability. Although previous research has shown that dopamine (DA) systems in prefrontal cortex are involved in impulsivity and substance abuse, it is not known if inherent variation in DA transporter (DAT) function contributes to impulsivity. The current study determined if individual differences in either impulsive action or impulsive choice are related to DAT function in orbitofrontal (OFC) and/or medial prefrontal cortex (mPFC). Rats were first tested both for impulsive action in a cued go/no-go task and for impulsive choice in a delay-discounting task. Following behavioral evaluation, in vitro [(3)H]DA uptake assays were performed in OFC and mPFC isolated from individual rats. Vmax in OFC, but not mPFC, was correlated with performance in the cued go/no-go task, with decreased OFC DAT function being associated with high impulsive action. In contrast, Vmax in OFC and mPFC was not correlated with performance in the delay-discounting task. The current results demonstrate that impulsive behavior in cued go/no-go performance is associated with decreased DAT function in OFC, suggesting that hyperdopaminergic tone in this prefrontal subregion mediates, at least in part, increased impulsive action.

Dissociable roles of dopamine and serotonin transporter function in a rat model of negative urgency

Negative urgency is a facet of impulsivity that reflects mood-based rash action and is associated with various maladaptive behaviors in humans. However, the underlying neural mechanisms of negative urgency are not fully understood. Several brain regions within the mesocorticolimbic pathway, as well as the neurotransmitters dopamine (DA) and serotonin (5-HT), have been implicated in impulsivity. Extracellular DA and 5-HT concentrations are regulated by DA transporters (DAT) and 5-HT transporters (SERT); thus, these transporters may be important molecular mechanisms underlying individual differences in negative urgency. The current study employed a reward omission task to model negative urgency in rats. During reward trials, a cue light signaled the non-contingent delivery of one sucrose pellet; immediately following the non-contingent reward, rats responded on a lever to earn sucrose pellets (operant phase). Omission trials were similar to reward trials, except that non-contingent sucrose was omitted following the cue light prior to the operant phase. As expected, contingent responding was higher following omission of expected reward than following delivery of expected reward, thus reflecting negative urgency. Upon completion of behavioral training, Vmax and Km were obtained from kinetic analysis of [(3)H]DA and [(3)H]5-HT uptake using synaptosomes prepared from nucleus accumbens (NAc), dorsal striatum (Str), medial prefrontal cortex (mPFC), and orbitofrontal cortex (OFC) isolated from individual rats. Vmax for DAT in NAc and for SERT in OFC were positively correlated with negative urgency scores. The current findings suggest that mood-based impulsivity (negative urgency) is associated with enhanced DAT function in NAc and SERT function in OFC.

Behavioral modeling of human choices reveals dissociable effects of physical effort and temporal delay on reward devaluation

There has been considerable interest from the fields of biology, economics, psychology, and ecology about how decision costs decrease the value of rewarding outcomes. For example, formal descriptions of how reward value changes with increasing temporal delays allow for quantifying individual decision preferences, as in animal species populating different habitats, or normal and clinical human populations. Strikingly, it remains largely unclear how humans evaluate rewards when these are tied to energetic costs, despite the surge of interest in the neural basis of effort-guided decision-making and the prevalence of disorders showing a diminished willingness to exert effort (e.g., depression). One common assumption is that effort discounts reward in a similar way to delay. Here we challenge this assumption by formally comparing competing hypotheses about effort and delay discounting. We used a design specifically optimized to compare discounting behavior for both effort and delay over a wide range of decision costs (Experiment 1). We then additionally characterized the profile of effort discounting free of model assumptions (Experiment 2). Contrary to previous reports, in both experiments effort costs devalued reward in a manner opposite to delay, with small devaluations for lower efforts, and progressively larger devaluations for higher effort-levels (concave shape). Bayesian model comparison confirmed that delay-choices were best predicted by a hyperbolic model, with the largest reward devaluations occurring at shorter delays. In contrast, an altogether different relationship was observed for effort-choices, which were best described by a model of inverse sigmoidal shape that is initially concave. Our results provide a novel characterization of human effort discounting behavior and its first dissociation from delay discounting. This enables accurate modelling of cost-benefit decisions, a prerequisite for the investigation of the neural underpinnings of effort-guided choice and for understanding the deficits in clinical disorders characterized by behavioral inactivity.

One of the main functions of the brain is to select sequences of actions that lead to rewarding outcomes (e.g., food). However, such rewards are often not readily available; instead physical effort may be required to obtain them, or their arrival may be delayed. The ability to integrate the costs and benefits of potential courses of action is severely impaired in several common disorders, such as depression and schizophrenia. Mathematical models can describe how individuals depreciate rewards based on the costs associated with them. For example, models of how a reward loses appeal with increasing temporal delays can provide individual impulsivity scores, and can serve as a predictor of financial mismanagement. To date, there is no established model to describe accurately how humans depreciate rewards when obtaining them requires physical effort. This is surprising given the prevalence of disorders related to a diminished willingness to exert effort. Here we derive a biologically plausible mathematical model that can describe how healthy humans make decisions tied to physical efforts. We show that effort and delay influence reward valuation in different ways, contrary to common assumptions. Our model will be important for characterizing decision-making deficits in clinical disorders characterized by behavioral inactivity.

The effect of acute morphine on delay discounting in dependent and non-dependent rats

RATIONALE

Chronic opiate use is associated with increased impulsivity in both humans and animals, and previous studies suggest that acute morphine can increase impulsivity in non-dependent rats. However, the extent to which chronic opiate usage modulates the effect of acute morphine is unknown.

METHODS

Rats were trained to delay discount 20 % sucrose solution and then randomly assigned to either a dependent group that received a nightly 30 mg/kg subcutaneous dose of morphine or a non-dependent group that received a nightly saline injection. Once dependence was established, rats were then assigned to one of four acute morphine doses (0, 1.25, 2.5, 5 mg/kg). For 5 days, delay discounting curves were determined 22.5 h after maintenance doses and 1 h after their prescribed acute injections.

RESULTS

In non-dependent rats, 2.5 and 5 mg/kg doses of morphine caused decreased preference for the large reward at all delays. Acute morphine had no effect on discounting curves in dependent rats.

CONCLUSIONS

Morphine dependence can cause tolerance to the effects of acute morphine on delay discounting.

Recent Insights into the Neurobiology of Impulsivity

Impulsivity is associated with various psychopathologies, and elevated impulsivity is typically disadvantageous. This manuscript reviews recent investigations into the neurobiology of impulsivity using human imaging techniques and animal models. Both human imaging and preclinical pharmacological manipulations have yielded important insights into the neurobiological underpinnings of impulsivity. A more thorough understanding of the complex neurobiology underlying aspects of impulsivity may provide insight into new treatment options that target elevated impulsivity and psychopathologies such as addictions.

Intake-dependent effects of cocaine self-administration on impulsive choice in a delay discounting task

Cocaine use is associated with high levels of impulsive choice (greater discounting of delayed rewards) in humans, but the cause/effect relationships between cocaine use and impulsive choice are not fully understood. In previous work, we found that both experimenter- and self-administration of fixed quantities of cocaine caused lasting increases in impulsive choice in rats. The present study extended these findings by taking into account baseline impulsive choice prior to self-administration and by allowing rats free access to cocaine. Male Long-Evans rats were trained in a delay discounting task in which they made discrete-trial choices between small immediate and large delayed food rewards. Half of the rats were then implanted with intravenous catheters and, following recovery, allowed to self-administer cocaine HCl (1.0 mg/kg/infusion) in 6-hr sessions over 14 days. Control rats orally self-administered a sucrose solution under similar conditions. Upon completion of self-administration, rats remained abstinent for 3 weeks before retesting in the delay discounting task. Cocaine and control groups did not differ prior to self-administration, but afterward, the cocaine group showed greater impulsive choice (fewer choices of large, delayed rewards) than controls. Additional analyses revealed that the effects of cocaine on impulsive choice were intake-dependent; rats classified as "low intake" did not differ from controls, whereas rats classified as "high intake" were significantly more impulsive than both controls and their precocaine baseline. These findings are consistent with the idea that cocaine-induced, pharmacologically based neural adaptations promote the development of impulsive decision making.

Partial inactivation of nucleus accumbens core decreases delay discounting in rats without affecting sensitivity to delay or magnitude

Increased preference for smaller, sooner rewards (delay discounting) is associated with several behavioral disorders, including ADHD and substance use disorders. However, delay discounting is a complex cognitive process and the relationship is unclear between the pathophysiology of the disorders and the component processes underlying delay discounting, including sensitivity to reinforcer delay and sensitivity to reinforcer magnitude. To investigate these processes, male Long Evans rats were trained in one of three tasks measuring sensitivity to delay, sensitivity to magnitude, or both (typical delay discounting task). After learning the task, animals were implanted with bilateral cannulae into either the nucleus accumbens core (AcbC) or the lateral orbitofrontal cortex (lOFC), both of which have been implicated in delay discounting. Upon recovering from the surgery, a baclofen/muscimol cocktail was infused to temporarily inactivate each of these two regions and task performance was assessed. Unlike previous studies showing that lesions of the AcbC increased delay discounting, partial inactivation of the AcbC decreased delay discounting, although it had no effects on the tasks independently assessing either sensitivity to delay or magnitude. The effects of AcbC inactivation were larger in animals that had low levels of delay discounting at baseline. Inactivation of the lOFC had no effects on behavior in any task. These findings suggest that the AcbC may act to promote impulsive choice in individuals with low impulsivity. Furthermore, the data suggest that the AcbC is able to modulate delay and magnitude sensitivity together, but not either of the two in isolation.