Dissociable regulation of instrumental action within mouse prefrontal cortex

Alcohol, flexible behavior, and the prefrontal cortex: Functional changes underlying impaired cognitive flexibility

Cognitive flexibility enables individuals to alter their behavior in response to changing environmental demands, facilitating optimal behavior in a dynamic world. The inability to do this, called behavioral inflexibility, is a pervasive behavioral phenotype in alcohol use disorder (AUD), driven by disruptions in cognitive flexibility. Research has repeatedly shown that behavioral inflexibility not only results from alcohol exposure across species but can itself be predictive of future drinking. Like many high-level executive functions, flexible behavior requires healthy functioning of the prefrontal cortex (PFC). The scope of this review addresses two primary themes: first, we outline tasks that have been used to investigate flexibility in the context of AUD or AUD models. We characterize these based on the task features and underlying cognitive processes that differentiate them from one another. We highlight the neural basis of flexibility measures, focusing on the PFC, and how acute or chronic alcohol in humans and non-human animal models impacts flexibility. Second, we consolidate findings on the molecular, physiological and functional changes in the PFC elicited by alcohol, that may contribute to cognitive flexibility deficits seen in AUD. Collectively, this approach identifies several key avenues for future research that will facilitate effective treatments to promote flexible behavior in the context of AUD, to reduce the risk of alcohol related harm, and to improve outcomes following AUD. This article is part of the Special Issue on "PFC circuit function in psychiatric disease and relevant models".

A hippocampo-cortical pathway detects changes in the validity of an action as a predictor of reward

Much research has been dedicated to understanding the psychological and neural bases of goal-directed action, yet the relationship between context and goal-directed action is not well understood. Here, we used excitotoxic lesions, chemogenetics, and circuit-specific manipulations to demonstrate the role of the ventral hippocampus (vHPC) in contextual learning that supports sensitivity to action-outcome contingencies, a hallmark of goal-directed action. We found that chemogenetic inhibition of the ventral, but not dorsal, hippocampus attenuated sensitivity to instrumental contingency degradation. We then tested the hypothesis that this deficit was due to an inability to discern the relative validity of the action compared with the context as a predictor of reward. Using latent inhibition and Pavlovian context conditioning, we confirm that degradation of action-outcome contingencies relies on intact context-outcome learning and show that this learning is dependent on vHPC. Finally, we show that chemogenetic inhibition of vHPC terminals in the medial prefrontal cortex also impairs both instrumental contingency degradation and context-outcome learning. These results implicate a hippocampo-cortical pathway in adapting to changes in instrumental contingencies and indicate that the psychological basis of this deficit is an inability to learn the predictive value of the context. Our findings contribute to a broader understanding of the neural bases of goal-directed action and its contextual regulation.

Short- and Long-Term High-Fat Diet Exposure Differentially Alters Phasic and Tonic GABAergic Signaling onto Lateral Orbitofrontal Pyramidal Neurons

The chronic consumption of caloric dense high-fat foods is a major contributor to increased body weight, obesity, and other chronic health conditions. The orbitofrontal cortex (OFC) is critical in guiding decisions about food intake and is altered with diet-induced obesity. Obese rodents have altered morphologic and synaptic electrophysiological properties in the lateral orbitofrontal cortex (lOFC). Yet the time course by which exposure to a high-fat diet (HFD) induces these changes is poorly understood. Here, male mice are exposed to either short-term (7 d) or long-term (90 d) HFD. Long-term HFD exposure increases body weight, and glucose signaling compared with short-term HFD or a standard control diet (SCD). Both short and long-term HFD exposure increased the excitability of lOFC pyramidal neurons. However, phasic and tonic GABAergic signaling was differentially altered depending on HFD exposure length, such that tonic GABAergic signaling was decreased with early exposure to the HFD and phasic signaling was changed with long-term diet exposure. Furthermore, alterations in the short-term diet exposure were transient, as removal of the diet restored electrophysiological characteristics similar to mice fed SCD, whereas long-term HFD electrophysiological changes were persistent and remained after HFD removal. Finally, we demonstrate that changes in reward devaluation occur early with diet exposure. Together, these results suggest that the duration of HFD exposure differentially alters lOFC function and provides mechanistic insights into the susceptibility of the OFC to impairments in outcome devaluation.SIGNIFICANCE STATEMENT This study provides mechanistic insight on the impact of short-term and long-term high-fat diet (HFD) exposure on GABAergic function in the lateral orbitofrontal cortex (lOFC), a region known to guide decision-making. We find short-term HFD exposure induces transient changes in firing and tonic GABA action on lOFC pyramidal neurons, whereas long-term HFD induces obesity and has lasting changes on firing, tonic GABA and inhibitory synaptic transmission onto lOFC neurons. Given that GABAergic signaling in the lOFC can influence decision-making around food, these results have important implications in present society as palatable energy dense foods are abundantly available.

Pathway specific interventions reveal the multiple roles of ventral hippocampus projections in cognitive functions

Since the 1950s study of Scoville and Milner on the case H.M., the hippocampus has attracted neuroscientists' attention. The hippocampus has been traditionally divided into dorsal and ventral parts, each of which projects to different brain structures and mediates various functions. Despite a predominant interest in its dorsal part in animal models, especially regarding episodic-like and spatial cognition, recent data highlight the role of the ventral hippocampus (vHPC), as the main hippocampal output, in cognitive processes. Here, we review recent studies conducted in rodents that have used advanced in vivo functional techniques to specifically monitor and manipulate vHPC efferent pathways and delineate the roles of these specific projections in learning and memory processes. Results highlight that vHPC projections to basal amygdala are implicated in emotional memory, to nucleus accumbens in social memory and instrumental actions and to prefrontal cortex in all the above as well as in object-based memory. Some of these hippocampal projections also modulate feeding and anxiety-like behaviours providing further evidence that the "one pathway-one function" view is outdated and future directions are proposed to better understand the role of hippocampal pathways and shed further light on its connectivity and function.

Separate orexigenic hippocampal ensembles shape dietary choice by enhancing contextual memory and motivation

The hippocampus (HPC), traditionally known for its role in learning and memory, has emerged as a controller of food intake. While prior studies primarily associated the HPC with food intake inhibition, recent research suggests a critical role in appetitive processes. We hypothesized that orexigenic HPC neurons differentially respond to fats and/or sugars, potent natural reinforcers that contribute to obesity development. Results uncover previously-unrecognized, spatially-distinct neuronal ensembles within the dorsal HPC (dHPC) that are responsive to separate nutrient signals originating from the gut. Using activity-dependent genetic capture of nutrient-responsive HPC neurons, we demonstrate a causal role of both populations in promoting nutrient-specific preference through different mechanisms. Sugar-responsive neurons encode an appetitive spatial memory engram for meal location, whereas fat-responsive neurons selectively enhance the preference and motivation for fat intake. Collectively, these findings uncover a neural basis for the exquisite specificity in processing macronutrient signals from a meal that shape dietary choices.

Contribution of dorsal versus ventral hippocampus to the hierarchical modulation of goal-directed actions in rats

Adaptive behaviour often necessitates that animals learn about events in a manner that is specific to a particular context or environment. These hierarchical organisations allow the animal to decide which action is the most appropriate when faced with ambiguous or conflicting possibilities. This study examined the role of hippocampus in enabling animals to use the context to guide action selection. We used a hierarchical instrumental outcome devaluation task in which male rats learn that the context provides information about the unique action-outcome relations that are in effect. We first confirmed that rats encode and use hierarchical context-(action-outcome) relations. We then show that chemogenetic inhibition of ventral hippocampus impairs both the encoding and retrieval of these associations, while inhibition of dorsal hippocampus impairs only the retrieval. Importantly, neither dorsal nor ventral hippocampus was required for goal-directed behaviour per se as these impairments only emerged when rats were forced to use the context to identify the current action-outcome relationships. These findings are discussed with respect to the role of the hippocampus and its broader circuitry in the contextual modulation of goal-directed behaviour and the importance of hierarchical associations in flexible behaviour.

Immp2l knockdown in male mice increases stimulus-driven instrumental behaviour but does not alter goal-directed learning or neuron density in cortico-striatal circuits in a model of Tourette syndrome and autism spectrum disorder

Cortico-striatal neurocircuits mediate goal-directed and habitual actions which are necessary for adaptive behaviour. It has recently been proposed that some of the core symptoms of autism spectrum disorder (ASD) and Gilles de la Tourette syndrome (GTS), such as tics and other repetitive behaviours, may emerge because of imbalances in these neurocircuits. We have recently developed a model of ASD and GTS by knocking down Immp2l, a mitochondrial gene frequently associated with these disorders. The current study sought to determine whether Immp2l knockdown (KD) in male mice alters flexible, goal- or cue- driven behaviour using procedures specifically designed to examine response-outcome and stimulus-response associations, which underlie goal-directed and habitual behaviour, respectively. Whether Immp2l KD alters neuron density in cortico-striatal neurocircuits known to regulate these behaviours was also examined. Immp2l KD mice and wild type-like mice (WT) were trained on Pavlovian and instrumental learning procedures where auditory cues predicted food delivery and lever-press responses earned a food outcome. It was demonstrated that goal-directed learning was not changed for Immp2l KD mice compared to WT mice, as lever-press responses were sensitive to changes in the value of the food outcome, and to contingency reversal and degradation. There was also no difference in the capacity of KD mice to form habitual behaviours compared to WT mice following extending training of the instrumental action. However, Immp2l KD mice were more responsive to auditory stimuli paired with food as indicated by a non-specific increase in lever response rates during Pavlovian-to-instrumental transfer. Finally, there were no alterations to neuron density in striatum or any prefrontal cortex or limbic brain structures examined. Thus, the current study suggests that Immp2l is not necessary for learned maladaptive goal or stimulus driven behaviours in ASD or GTS, but that it may contribute to increased capacity for external stimuli to drive behaviour. Alterations to stimulus-driven behaviour could potentially influence the expression of tics and repetitive behaviours, suggesting that genetic alterations to Immp2l may contribute to these core symptoms in ASD and GTS. Given that this is the first application of this battery of instrumental learning procedures to a mouse model of ASD or GTS, it is an important initial step in determining the contribution of known risk-genes to goal-directed versus habitual behaviours, which should be more broadly applied to other rodent models of ASD and GTS in the future.

GluN2B inhibition confers resilience against long-term cocaine-induced neurocognitive sequelae

Cocaine self-administration can disrupt the capacity of humans and rodents to flexibly modify familiar behavioral routines, even when they become maladaptive or unbeneficial. However, mechanistic factors, particularly those driving long-term behavioral changes, are still being determined. Here, we capitalized on individual differences in oral cocaine self-administration patterns in adolescent mice and revealed that the post-synaptic protein PSD-95 was reduced in the orbitofrontal cortex (OFC) of escalating, but not stable, responders, which corresponded with later deficits in flexible decision-making behavior. Meanwhile, NMDA receptor GluN2B subunit content was lower in the OFC of mice that were resilient to escalatory oral cocaine seeking. This discovery led us to next co-administer the GluN2B-selective antagonist ifenprodil with cocaine, blocking the later emergence of cocaine-induced decision-making abnormalities. GluN2B inhibition also prevented cocaine-induced dysregulation of neuronal structure and function in the OFC, preserving mature, mushroom-shaped dendritic spine densities on deep-layer pyramidal neurons, which were otherwise lower with cocaine, and safeguarding functional BLA→OFC connections necessary for action flexibility. We posit that cocaine potentiates GluN2B-dependent signaling, which triggers a series of durable adaptations that result in the dysregulation of post-synaptic neuronal structure in the OFC and disruption of BLA→OFC connections, ultimately weakening the capacity for flexible choice. And thus, inhibiting GluN2B-NMDARs promotes resilience to long-term cocaine-related sequelae.

Medial orbitofrontal cortical regulation of different aspects of Pavlovian and instrumental reward seeking

RATIONALE

The medial subregion of the orbitofrontal cortex (mOFC) is thought to play an important role representing the expected outcome of a given course of action, as lesioning or inactivating this cortical region results in the adoption of choice strategies based more on observable (rather than previously learned) information. Despite this, its role in mediating basic associative learning remains to be fully clarified.

OBJECTIVE

The present series of experiments examined the role of the mOFC in (1) Pavlovian conditioned approach, (2) conditioned reinforcement, (3) extinction, and (4) cue-induced reinstatement of food-seeking behavior.

METHODS

Separate cohorts of rats went through Pavlovian or instrumental training. Intra-mOFC infusions of either saline or GABA agonists (to temporarily inactivate neural activity) were given prior to Pavlovian approach, conditioned reinforcement, first or second day of instrumental extinction training, or cue-induced reinstatement test days.

RESULTS

mOFC inactivation increased lever-CS contacts in Pavlovian conditioned approach and (2) had no effect on conditioned reinforcement. These manipulations (3) accelerated within-session instrumental extinction during the initial extinction session, but impaired subsequent extinction learning on drug-free days. (4) mOFC inactivation induced differential effects on reinstatement that depended on baseline performance. mOFC inactivation abolished reinstatement in "Reinstater" rats (who displayed robust responding under control conditions) and robustly increased reinstatement in "Non-Reinstater" rats (who showed little reinstatement under control conditions) suggesting that individual differences in reinstatement may be supported by differences in mOFC mediated representations of expected outcomes.

CONCLUSIONS

These findings have important implications for understanding how the mOFC uses stimulus-outcome and action-outcome expectancies to guide behavior, and how dysfunction within this region may contribute to pathological patterns of reward seeking.

Projections from the five divisions of the orbital cortex to the thalamus in the rat

The orbital cortex (ORB) of the rat consists of five divisions: the medial (MO), ventral (VO), ventrolateral (VLO), lateral (LO), and dorsolateral (DLO) orbital cortices. No previous report has comprehensively examined and compared projections from each division of the ORB to the thalamus. Using the anterograde anatomical tracer, Phaseolus vulgaris leucoagglutinin, we describe the efferent projections from the five divisions of the ORB to the thalamus in the rat. We demonstrated that, with some overlap, each division of the ORB distributed in a distinct (and unique) manner to nuclei of the thalamus. Overall, ORB projected to a relatively restricted number of sites in the thalamus, and strikingly distributed entirely to structures of the medial/midline thalamus, while completely avoiding lateral regions or principal nuclei of the thalamus. The main termination sites in the thalamus were the paratenial nucleus (PT) and nucleus reuniens (RE) of the midline thalamus, the medial (MDm) and central (MDc) divisions of the mediodorsal nucleus, the intermediodorsal nucleus, the central lateral, paracentral, and central medial nuclei of the rostral intralaminar complex and the submedial nucleus (SM). With some exceptions, medial divisions of the ORB (MO, VO) mainly targeted "limbic-associated" nuclei such as PT, RE, and MDm, whereas lateral division (VLO, LO, DLO) primarily distributed to "sensorimotor-associated" nuclei including MDc, SM, and the rostral intralaminar complex. As discussed herein, the medial/midline thalamus may represent an important link (or bridge) between the orbital cortex and the hippocampus and between the ORB and medial prefrontal cortex. In summary, the present results demonstrate that each division of the orbital cortex projects in a distinct manner to nuclei of the thalamus which suggests unique functions for each division of the orbital cortex.

Intense long-term training impairs brain health compared with moderate exercise: Experimental evidence and mechanisms

The consequences of extremely intense long-term exercise for brain health remain unknown. We studied the effects of strenuous exercise on brain structure and function, its dose-response relationship, and mechanisms in a rat model of endurance training. Five-week-old male Wistar rats were assigned to moderate (MOD) or intense (INT) exercise or a sedentary (SED) group for 16 weeks. MOD rats showed the highest motivation and learning capacity in operant conditioning experiments; SED and INT presented similar results. In vivo MRI demonstrated enhanced global and regional connectivity efficiency and clustering as well as a higher cerebral blood flow (CBF) in MOD but not INT rats compared with SED. In the cortex, downregulation of oxidative phosphorylation complex IV and AMPK activation denoted mitochondrial dysfunction in INT rats. An imbalance in cortical antioxidant capacity was found between MOD and INT rats. The MOD group showed the lowest hippocampal brain-derived neurotrophic factor levels. The mRNA and protein levels of inflammatory markers were similar in all groups. In conclusion, strenuous long-term exercise yields a lesser improvement in learning ability than moderate exercise. Blunting of MOD-induced improvements in CBF and connectivity efficiency, accompanied by impaired mitochondrial energetics and, possibly, transient local oxidative stress, may underlie the findings in intensively trained rats.

EGR3 regulates opioid-related nociception and motivation in male rats

Chronic pain can be a debilitating condition, leading to profound changes in nearly every aspect of life. However, the reliance on opioids such as oxycodone for pain management is thought to initiate dependence and addiction liability. The neurobiological intersection at which opioids relieve pain and possibly transition to addiction is poorly understood. Using RNA sequencing pathway analysis in rats with complete Freund's adjuvant (CFA)-induced chronic inflammation, we found that the transcriptional signatures in the medial prefrontal cortex (mPFC; a brain region where pain and reward signals integrate) elicited by CFA in combination with oxycodone differed from those elicited by CFA or oxycodone alone. However, the expression of Egr3 was augmented in all animals receiving oxycodone. Furthermore, virus-mediated overexpression of EGR3 in the mPFC increased mechanical pain relief but not the affective aspect of pain in animals receiving oxycodone, whereas pharmacological inhibition of EGR3 via NFAT attenuated mechanical pain relief. Egr3 overexpression also increased the motivation to obtain oxycodone infusions in a progressive ratio test without altering the acquisition or maintenance of oxycodone self-administration. Taken together, these data suggest that EGR3 in the mPFC is at the intersection of nociceptive and addictive-like behaviors.

Medial orbitofrontal neurotrophin systems integrate hippocampal input into outcome-specific value representations

In everyday life, we mentally represent possible consequences of our behaviors and integrate specific outcome values into existing knowledge to inform decisions. The medial orbitofrontal cortex (MO) is necessary to adapt behaviors when outcomes are not immediately available-when they and their values need to be envisioned. Nevertheless, neurobiological mechanisms remain unclear. We find that the neuroplasticity-associated neurotrophin receptor tropomyosin receptor kinase B (TrkB) is necessary for mice to integrate outcome-specific value information into choice behavior. This function appears attributable to memory updating (and not retrieval) and the stabilization of dendritic spines on excitatory MO neurons, which led us to investigate inputs to the MO. Ventral hippocampal (vHC)-to-MO projections appear conditionally necessary for value updating, involved in long-term aversion-based value memory updating. Furthermore, vHC-MO-mediated control of choice is TrkB dependent. Altogether, we reveal a vHC-MO connection by which specific value memories are updated, and we position TrkB within this functional circuit.

Acute restraint stress redirects prefrontal cortex circuit function through mGlu5 receptor plasticity on somatostatin-expressing interneurons

Inhibitory interneurons orchestrate prefrontal cortex (PFC) activity, but we have a limited understanding of the molecular and experience-dependent mechanisms that regulate synaptic plasticity across PFC microcircuits. We discovered that mGlu5 receptor activation facilitates long-term potentiation at synapses from the basolateral amygdala (BLA) onto somatostatin-expressing interneurons (SST-INs) in mice. This plasticity appeared to be recruited during acute restraint stress, which induced intracellular calcium mobilization within SST-INs and rapidly potentiated postsynaptic strength onto SST-INs. Restraint stress and mGlu5 receptor activation each augmented BLA recruitment of SST-IN phasic feedforward inhibition, shunting information from other excitatory inputs, including the mediodorsal thalamus. Finally, studies using cell-type-specific mGlu5 receptor knockout mice revealed that mGlu5 receptor function in SST-expressing cells is necessary for restraint stress-induced changes to PFC physiology and related behaviors. These findings provide new insights into interneuron-specific synaptic plasticity mechanisms and suggest that SST-IN microcircuits may be promising targets for treating stress-induced psychiatric diseases.

GABAB receptors in prelimbic cortex and basolateral amygdala differentially influence intertemporal decision making and decline with age

The ability to decide adaptively between immediate vs. delayed gratification (intertemporal choice) is critical for well-being and is associated with a range of factors that influence quality of life. In contrast to young adults, many older adults show enhanced preference for delayed gratification; however, the neural mechanisms underlying this age difference in intertemporal choice are largely un-studied. Changes in signaling through GABA_B receptors (GABA_BRs) mediate several age-associated differences in cognitive processes linked to intertemporal choice. The current study used a rat model to determine how GABA_BRs in two brain regions known to regulate intertemporal choice (prelimbic cortex; PrL and basolateral amygdala; BLA) contribute to age differences in this form of decision making in male rats. As in humans, aged rats showed enhanced preference for large, delayed over small, immediate rewards during performance in an intertemporal choice task in operant test chambers. Activation of PrL GABA_BRs via microinfusion of the agonist baclofen increased choice of large, delayed rewards in young adult rats but did not influence choice in aged rats. Conversely, infusion of baclofen into the BLA strongly reduced choice of large, delayed rewards in both young adult and aged rats. Aged rats further showed a significant reduction in expression of GABA_BR1 subunit isoforms in the prefrontal cortex, a discovery that is consonant with the null effect of intra-PrL baclofen on intertemporal choice in aged rats. In contrast, expression of GABA_BR subunits was generally conserved with age in the BLA. Jointly, these findings elucidate a role for GABA_BRs in intertemporal choice and identify fundamental features of brain maturation and aging that mediate an improved ability to delay gratification.

Suppression of pyramidal neuron G protein-gated inwardly rectifying K+ channel signaling impairs prelimbic cortical function and underlies stress-induced deficits in cognitive flexibility in male, but not female, mice

Imbalance in prefrontal cortical (PFC) pyramidal neuron excitation:inhibition is thought to underlie symptomologies shared across stress-related disorders and neuropsychiatric disease, including dysregulation of emotion and cognitive function. G protein-gated inwardly rectifying K+ (GIRK/Kir3) channels mediate excitability of medial PFC pyramidal neurons, however, the functional role of these channels in mPFC-dependent regulation of affect, cognition, and cortical dynamics is unknown. We used a viral-cre approach in male and female mice harboring a "floxed" version of the kcnj3 (Girk1) gene, to disrupt GIRK1-containing channel expression in pyramidal neurons within the prelimbic cortex (PrL). In males, loss of pyramidal GIRK1-dependent signaling differentially impacted measures of affect and impaired working memory and cognitive flexibility. Unexpectedly, ablation of PrL GIRK1-dependent signaling did not impact affect or cognition in female mice. Additional studies used a model of chronic unpredictable stress (CUS) to determine the impact on PrL GIRK-dependent signaling and cognitive function. CUS exposure in male mice produced deficits in cognition that paralleled a reduction in PrL pyramidal GIRK-dependent signaling akin to viral approaches whereas CUS exposure in female mice did not alter cognitive flexibility performance. Stress-induced behavioral deficits in male mice were rescued by systemic injection of a novel, GIRK1-selective agonist, ML297. In conclusion, GIRK1-dependent signaling in male mice, but not females, is critical for maintaining optimal PrL function and behavioral control. Disruption of this inhibition may underlie stress-related dysfunction of the PrL and represent a therapeutic target for treating stress-induced deficits in affect regulation and impaired cognition that reduce quality of life.

Chronic Distress in Male Mice Impairs Motivation Compromising Both Effort and Reward Processing With Altered Anterior Insular Cortex and Basolateral Amygdala Neural Activation

In humans and mammals, effort-based decision-making for monetary or food rewards paradigms contributes to the study of adaptive goal-directed behaviours acquired through reinforcement learning. Chronic distress modelled by repeated exposure to glucocorticoids in rodents induces suboptimal decision-making under uncertainty by impinging on instrumental acquisition and prompting negative valence behaviours. In order to further disentangle the motivational tenets of adaptive decision-making, this study addressed the consequences of enduring distress on relevant effort and reward-processing dimensions. Experimentally, appetitive and consummatory components of motivation were evaluated in adult C57BL/6JRj male mice experiencing chronic distress induced by oral corticosterone (CORT), using multiple complementary discrete behavioural tests. Behavioural data (from novelty suppressed feeding, operant effort-based choice, free feeding, and sucrose preference tasks) collectively show that behavioural initiation, effort allocation, and hedonic appreciation and valuation are altered in mice exposed to several weeks of oral CORT treatment. Additionally, data analysis from FosB immunohistochemical processing of postmortem brain samples highlights CORT-dependent dampening of neural activation in the anterior insular cortex (aIC) and basolateral amygdala (BLA), key telencephalic brain regions involved in appetitive and consummatory motivational processing. Combined, these results suggest that chronic distress-induced irregular aIC and BLA neural activations with reduced effort production and attenuated reward value processing during reinforcement-based instrumental learning could result in maladaptive decision-making under uncertainty. The current study further illustrates how effort and reward processing contribute to adjust the motivational threshold triggering goal-directed behaviours in versatile environments.

Segregating domain-general from emotional context-specific inhibitory control systems - ventral striatum and orbitofrontal cortex serve as emotion-cognition integration hubs

Inhibitory control hierarchically regulates cognitive and emotional systems in the service of adaptive goal-directed behavior across changing task demands and environments. While previous studies convergently determined the contribution of prefrontal-striatal systems to general inhibitory control, findings on the specific circuits that mediate emotional context-specific impact on inhibitory control remained inconclusive. Against this background we combined an evaluated emotional Go/No Go task with fMRI in a large cohort of subjects (N=250) to segregate brain systems and circuits that mediate domain-general from emotion-specific inhibitory control. Particularly during a positive emotional context, behavioral results showed a lower accuracy for No Go trials and a faster response time for Go trials. While the dorsal striatum and lateral frontal regions were involved in inhibitory control irrespective of emotional context, activity in the ventral striatum (VS) and medial orbitofrontal cortex (mOFC) varied as a function of emotional context. On the voxel-wise whole-brain network level, limbic and striatal systems generally exhibited highest changes in global brain connectivity during inhibitory control, while global brain connectivity of the left mOFC was less decreased during emotional contexts. Functional connectivity analyses moreover revealed that negative coupling between the VS with inferior frontal gyrus (IFG)/insula and mOFC varied as a function of emotional context. Together these findings indicate separable domain- general as well as emotional context-specific inhibitory brain systems which specifically encompass the VS and its connections with frontal regions.

Dissociable and Paradoxical Roles of Rat Medial and Lateral Orbitofrontal Cortex in Visual Serial Reversal Learning

Much evidence suggests that reversal learning is mediated by cortico-striatal circuitries with the orbitofrontal cortex (OFC) playing a prominent role. The OFC is a functionally heterogeneous region, but potential differential roles of lateral (lOFC) and medial (mOFC) portions in visual reversal learning have yet to be determined. We investigated the effects of pharmacological inactivation of mOFC and lOFC on a deterministic serial visual reversal learning task for rats. For reference, we also targeted other areas previously implicated in reversal learning: prelimbic (PrL) and infralimbic (IL) prefrontal cortex, and basolateral amygdala (BLA). Inactivating mOFC and lOFC produced opposite effects; lOFC impairing, and mOFC improving, performance in the early, perseverative phase specifically. Additionally, mOFC inactivation enhanced negative feedback sensitivity, while lOFC inactivation diminished feedback sensitivity in general. mOFC and lOFC inactivation also affected novel visual discrimination learning differently; lOFC inactivation paradoxically improved learning, and mOFC inactivation had no effect. We also observed dissociable roles of the OFC and the IL/PrL. Whereas the OFC inactivation affected only perseveration, IL/PrL inactivation improved learning overall. BLA inactivation did not affect perseveration, but improved the late phase of reversal learning. These results support opponent roles of the rodent mOFC and lOFC in deterministic visual reversal learning.

Unlocking the reinforcement-learning circuits of the orbitofrontal cortex

Neuroimaging studies have consistently identified the orbitofrontal cortex (OFC) as being affected in individuals with neuropsychiatric disorders. OFC dysfunction has been proposed to be a key mechanism by which decision-making impairments emerge in diverse clinical populations, and recent studies employing computational approaches have revealed that distinct reinforcement-learning mechanisms of decision-making differ among diagnoses. In this perspective, we propose that these computational differences may be linked to select OFC circuits and present our recent work that has used a neurocomputational approach to understand the biobehavioral mechanisms of addiction pathology in rodent models. We describe how combining translationally analogous behavioral paradigms with reinforcement-learning algorithms and sophisticated neuroscience techniques in animals can provide critical insights into OFC pathology in biobehavioral disorders. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

The stressed orbitofrontal cortex

Stressor exposure causes dendritic remodeling on excitatory neurons in multiple regions of the brain, including the orbitofrontal cortex (OFC). Additionally, stressor and exogenous stress hormone exposure impair cognitive functions that are dependent on the OFC. For this Special Issue on the OFC, we summarize current literature regarding how stress-prenatal, postnatal, and even inter-generational-affects OFC neuron structure in rodents. We discuss dendrite structure, dendritic spines, and gene expression. We aim to provide a focused resource for those interested in how stressors impact this heterogeneous brain region. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

The effects of fatty acid amide hydrolase inhibition and monoacylglycerol lipase inhibition on habit formation in mice

Emerging data indicate that endocannabinoid signaling is critical to the formation of habitual behavior. Previous work demonstrated that antagonism of cannabinoid receptor type 1 (CB1R) with AM251 during operant training impairs habit formation, but it is not known if this behavioral effect is specific to disrupted signaling of the endocannabinoid ligands anandamide or 2-arachidonoyl glycerol (2-AG). Here, we used selective pharmacological compounds during operant training to determine the impact of fatty acid amide hydrolase (FAAH) inhibition to increase anandamide (and other n-acylethanolamines) or monoacylglycerol lipase (MAGL) inhibition to increase 2-AG levels on the formation of habitual behaviors in mice using a food-reinforced contingency degradation procedure. We found, contrary to our hypothesis, that inhibition of FAAH and of MAGL disrupted the formation of habits. Next, AM251 was administered during training to verify that impaired habit formation could be assessed using contingency degradation. AM251-exposed mice responded at lower rates during training and at higher rates in the test. To understand the inconsistency with published data, we performed a proof-of-principle dose-response experiment to compare AM251 in our vehicle-solution to the published vehicle-suspension on response rates. We found consistent reductions in response rate with increasing doses of AM251 in solution and an inconsistent dose-response relationship with AM251 in suspension. Together, our data suggest that further characterization of the role of CB1R signaling in the formation of habitual responding is warranted and that augmenting endocannabinoids may have clinical utility for prophylactically preventing aberrant habit formation such as that hypothesized to occur in substance use disorders.

K369I Tau Mice Demonstrate a Shift Towards Striatal Neuron Burst Firing and Goal-directed Behaviour

Pathological forms of the microtubule-associated protein tau are involved in a large group of neurodegenerative diseases named tauopathies, including frontotemporal lobar degeneration (FTLD-tau). K369I mutant tau transgenic mice (K3 mice) recapitulate neural and behavioural symptoms of FTLD, including tau aggregates in the cortex, alterations to nigrostriatum, memory deficits and parkinsonism. The aim of this study was to further characterise the K3 mouse model by examining functional alterations to the striatum. Whole-cell patch-clamp electrophysiology was used to investigate the properties of striatal neurons in K3 mice and wildtype controls. Additionally, striatal-based instrumental learning tasks were conducted to assess goal-directed versus habitual behaviours (i.e., by examining sensitivity to outcome devaluation and progressive ratios). The K3 model demonstrated significant alterations in the discharge properties of striatal neurons relative to wildtype mice, which manifested as a shift in neuronal output towards a burst firing state. K3 mice acquired goal-directed responding faster than control mice and were goal-directed at test unlike wildtype mice, which is likely to indicate reduced capacity to develop habitual behaviour. The observed pattern of behaviour in K3 mice is suggestive of deficits in dorsal lateral striatal function and this was supported by our electrophysiological findings. Thus, both the electrophysiological and behavioural alterations indicate that K3 mice have early deficits in striatal function. This finding adds to the growing literature which indicate that the striatum is impacted in tau-related neuropathies such as FTLD, and further suggests that the K3 model is a unique mouse model for investigating FTLD especially with striatal involvement.

Mu-Opioids Suppress GABAergic Synaptic Transmission onto Orbitofrontal Cortex Pyramidal Neurons with Subregional Selectivity

The orbitofrontal cortex (OFC) plays a critical role in evaluating outcomes in a changing environment. Administering opioids to the OFC can alter the hedonic reaction to food rewards and increase their consumption in a subregion-specific manner. However, it is unknown how mu-opioid signaling influences synaptic transmission in the OFC. Thus, we investigated the cellular actions of mu-opioids within distinct subregions of the OFC. Using in vitro patch-clamp electrophysiology in brain slices containing the OFC, we found that the mu-opioid agonist DAMGO produced a concentration-dependent inhibition of GABAergic synaptic transmission onto medial OFC (mOFC), but not lateral OFC (lOFC) neurons. This effect was mediated by presynaptic mu-opioid receptor activation of local parvalbumin (PV⁺)-expressing interneurons. The DAMGO-induced suppression of inhibition was long lasting and not reversed on washout of DAMGO or by application of the mu-opioid receptor antagonist CTAP, suggesting an inhibitory long-term depression (LTD) induced by an exogenous mu-opioid. We show that LTD at inhibitory synapses is dependent on downstream cAMP/protein kinase A (PKA) signaling, which differs between the mOFC and lOFC. Finally, we demonstrate that endogenous opioid release triggered via moderate physiological stimulation can induce LTD. Together, these results suggest that presynaptic mu-opioid stimulation of local PV⁺ interneurons induces a long-lasting suppression of GABAergic synaptic transmission, which depends on subregional differences in mu-opioid receptor coupling to the downstream cAMP/PKA intracellular cascade. These findings provide mechanistic insight into the opposing functional effects produced by mu-opioids within the OFC.SIGNIFICANCE STATEMENT Considering that both the orbitofrontal cortex (OFC) and the opioid system regulate reward, motivation, and food intake, understanding the role of opioid signaling within the OFC is fundamental for a mechanistic understanding of the sequelae for several psychiatric disorders. This study makes several novel observations. First, mu-opioids induce a long-lasting suppression of inhibitory synaptic transmission onto OFC pyramidal neurons in a regionally selective manner. Second, mu-opioids recruit parvalbumin inputs to suppress inhibitory synaptic transmission in the mOFC. Third, the regional selectivity of mu-opioid action of endogenous opioids is due to the efficacy of mu-opioid receptor coupling to the downstream cAMP/PKA intracellular cascades. These experiments are the first to reveal a cellular mechanism of opioid action within the OFC.

Glutamatergic and Serotonergic Modulation of Rat Medial and Lateral Orbitofrontal Cortex in Visual Serial Reversal Learning

Adapting behavior to a dynamic environment requires both steadiness when the environment is stable and behavioral flexibility in response to changes. Much evidence suggests that cognitive flexibility, which can be operationalized in reversal learning tasks, is mediated by cortico-striatal circuitries, with the orbitofrontal cortex (OFC) playing a prominent role. The OFC is a functionally heterogeneous region, and we have previously reported differential roles of lateral (lOFC) and medial (mOFC) regions in a touchscreen serial visual reversal learning task for rats using pharmacological inactivation. Here, we investigated the effects of pharmacological overactivation of these regions using a glutamate transporter 1 (GLT-1) inhibitor, dihydrokainate (DHK), which increases extracellular glutamate by blocking its reuptake. We also tested the impact of antagonism of the serotonin 2A receptor (5-HT_2AR), which modulates glutamate action, in the mOFC and lOFC on the same task. Overactivation induced by DHK produced dissociable effects in the mOFC and lOFC, with more prominent effects in the mOFC, specifically improving performance in the early, perseveration phase. Intra-lOFC DHK increased the number of omitted responses without affecting errors. In contrast, blocking the 5-HT_2AR in the lOFC impaired reversal learning overall, while mOFC 5-HT_2AR blockade had no effect. These results further support dissociable roles of the rodent mOFC and lOFC in deterministic visual reversal learning and indicate that modulating glutamate transmission through blocking the GLT-1 and the 5-HT_2AR have different roles in these two structures.

This study further supports dissociable roles of specific orbitofrontal subregions, as well as glutamatergic and serotonergic transmission in these subregions, in cognitive flexibility. This knowledge will add to the understanding of specific neural mechanisms underlying inflexible behaviour across psychiatric disorders.

Involvement of the rodent prelimbic and medial orbitofrontal cortices in goal-directed action: A brief review

Goal-directed action refers to selecting behaviors based on the expectation that they will be reinforced with desirable outcomes. It is typically conceptualized as opposing habit-based behaviors, which are instead supported by stimulus-response associations and insensitive to consequences. The prelimbic prefrontal cortex (PL) is positioned along the medial wall of the rodent prefrontal cortex. It is indispensable for action-outcome-driven (goal-directed) behavior, consolidating action-outcome relationships and linking contextual information with instrumental behavior. In this brief review, we will discuss the growing list of molecular factors involved in PL function. Ventral to the PL is the medial orbitofrontal cortex (mOFC). We will also summarize emerging evidence from rodents (complementing existing literature describing humans) that it too is involved in action-outcome conditioning. We describe experiments using procedures that quantify responding based on reward value, the likelihood of reinforcement, or effort requirements, touching also on experiments assessing food consumption more generally. We synthesize these findings with the argument that the mOFC is essential to goal-directed action when outcome value information is not immediately observable and must be recalled and inferred.

Selective impact of lateral orbitofrontal cortex inactivation on reinstatement of alcohol seeking in male Long-Evans rats

The orbitofrontal cortex (OFC) plays a fundamental role in motivated behavior and decision-making. In humans, OFC structure and function is significantly disrupted in drug using and dependent individuals, including those exhibiting chronic alcohol use and alcoholism. In animal models, the OFC has been shown to significantly influence the seeking of non-alcohol drugs of abuse. However direct investigations of the OFC during alcohol seeking and use have been more limited. In the studies reported here, we inactivated lateral (lOFC) or medial OFC (mOFC) subregions in rats during multiple stages of alcohol seeking. After one month of intermittent access to homecage 20% ethanol (EtOH), rats were trained to self-administer EtOH under an FR3 schedule and implanted with cannulae directed to lOFC or mOFC. We inactivated OFC subregions with baclofen/muscimol during EtOH self-administration, extinction, cue-induced reinstatement, and progressive ratio testing to broadly characterize the influence of these subregions on alcohol seeking. There were no significant effects of mOFC or lOFC inactivation during FR3 self-administration, extinction, or progressive ratio self-administration. However, lOFC, and not mOFC, inactivation significantly decreased cue-induced reinstatement of EtOH seeking. These findings contribute new information to the specific impact of OFC manipulation on operant alcohol seeking, support previous studies investigating the role of OFC in seeking and consumption of alcohol and other drugs of abuse, and indicate a specific role for lOFC vs. mOFC in reinstatement.

Action-Outcome Expectancies Require Orbitofrontal Neurotrophin Systems in Naïve and Cocaine-Exposed Mice

Cocaine use during adolescence decreases the likelihood that individuals will seek treatment for recurrent drug use. In rodents, developmental cocaine exposure weakens action-consequence decision-making, causing a deferral to familiar, habit-like behavioral response strategies. Here, we aimed to improve action-outcome decision-making. We found that acute pharmacological stimulation of the tyrosine/tropomyosin receptor kinase B (trkB) via 7,8-dihydroxyflavone (7,8-DHF) or 3,4-methylenedioxymethamphetamine (MDMA) blocked cocaine-induced habit biases by strengthening memory for action-outcome associations. We believe that MDMA acts by stimulating neurotrophin/trkB systems in the orbitofrontal cortex (OFC), a region involved in prospectively evaluating the consequences of one's action, because 1) MDMA also increased brain-derived neurotrophic factor (BDNF) in the OFC, 2) MDMA corrected habit biases due to Bdnf loss in the OFC, and 3) overexpression of a truncated isoform of trkB occluded the memory-enhancing effects of MDMA. Thus, selecting actions based on their consequences requires BDNF-trkB in the OFC, the stimulation of which may improve goal attainment in both drug-naïve and cocaine-exposed individuals. SIGNIFICANCE STATEMENT: Cocaine use during adolescence decreases the likelihood that individuals will seek treatment for recurrent drug use, even as adults. Understanding how early-life cocaine exposure impacts goal-oriented action and prospective decision-making in adulthood is thus important. One key aspect of goal-directed decision-making is anticipating the consequences of one's actions, a process that likely involves the orbitofrontal cortex (OFC). In rodents, developmental cocaine exposure weakens action-consequence decision-making, causing a deferral to familiar, habit-like behavioral response strategies. Here, we report that we can improve memory for action-consequence relationships by stimulating neurotrophic factors, which support cell survival, development, and plasticity in the brain. With strengthened action-consequence associations, cocaine-exposed mice regain the ability to optimally select actions based on their likely outcomes. Brain region-selective manipulations reveal that neurotrophin systems in the OFC are necessary for stable memory of action-consequence relationships.

β1-Integrins in the Developing Orbitofrontal Cortex Are Necessary for Expectancy Updating in Mice

Navigating a changing environment requires associating stimuli and actions with their likely outcomes and modifying these associations when they change. These processes involve the orbitofrontal cortex (OFC). Although some molecular mediators have been identified, developmental factors are virtually unknown. We hypothesized that the cell adhesion factor β1-integrin is essential to OFC function, anticipating developmental windows during which β1-integrins might be more influential than others. We discovered that OFC-selective β1-integrin silencing before adolescence, but not later, impaired the ability of mice to extinguish conditioned fear and select actions based on their likely outcomes. Early-life knock-down also reduced the densities of dendritic spines, the primary sites of excitatory plasticity in the brain, and weakened sensitivity to cortical inputs. Notwithstanding these defects in male mice, females were resilient to OFC (but not hippocampal) β1-integrin loss. Existing literature suggests that resilience may be explained by estradiol-mediated transactivation of β1-integrins and tropomyosin receptor kinase B (trkB). Accordingly, we discovered that a trkB agonist administered during adolescence corrected reward-related decision making in β1-integrin-deficient males. In sum, developmental β1-integrins are indispensable for OFC function later in life.SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) is a subregion of the frontal cortex that allows organisms to link behaviors and stimuli with anticipated outcomes, and to make predictions about the consequences of one's behavior. Aspects of OFC development are particularly prolonged, extending well into adolescence, likely optimizing organisms' abilities to prospectively calculate the consequences of their actions and select behaviors appropriately; these decision making strategies improve as young individuals mature into adulthood. Molecular factors are not, however, well understood. Our experiments reveal that a cell adhesion protein termed "β1-integrin" is necessary for OFC neuronal maturation and function. Importantly, β1-integrins operate during a critical period equivalent to early adolescence in humans to optimize the ability of organisms to update expectancies later in life.

Impaired instrumental reversal learning is associated with increased medial prefrontal cortex activity in Sapap3 knockout mouse model of compulsive behavior

Convergent functional neuroimaging findings implicate hyperactivity across the prefrontal cortex (PFC) and striatum in the neuropathology of obsessive compulsive disorder (OCD). The impact of cortico-striatal circuit hyperactivity on executive functions subserved by these circuits is unclear, because impaired recruitment of PFC has also been observed in OCD patients during paradigms assessing cognitive flexibility. To investigate the relationship between cortico-striatal circuit disturbances and cognitive functioning relevant to OCD, Sapap3 knockout mice (KOs) and littermate controls were tested in an instrumental reversal-learning paradigm to assess cognitive flexibility. Cortical and striatal activation associated with reversal learning was assessed via quantitative analysis of expression of the immediate early gene cFos and generalized linear mixed-effects models. Sapap3-KOs displayed heterogeneous reversal-learning performance, with almost half (n = 13/28) failing to acquire the reversed contingency, while the other 15/28 had similar acquisition as controls. Notably, reversal impairments were not correlated with compulsive grooming severity. cFos analysis revealed that reversal performance declined as medial PFC (mPFC) activity increased in Sapap3-KOs. No such relationship was observed in controls. Our studies are among the first to describe cognitive impairments in a transgenic OCD-relevant model, and demonstrate pronounced heterogeneity among Sapap3-KOs. These findings suggest that increased neural activity in mPFC is associated with impaired reversal learning in Sapap3-KOs, providing a likely neural basis for this observed heterogeneity. The Sapap3-KO model is thus a useful tool for future mechanistic studies to determine how mPFC hyperactivity contributes to OCD-relevant cognitive dysfunction.

Reward-Related Expectations Trigger Dendritic Spine Plasticity in the Mouse Ventrolateral Orbitofrontal Cortex

An essential aspect of goal-directed decision-making is selecting actions based on anticipated consequences, a process that involves the orbitofrontal cortex (OFC) and potentially, the plasticity of dendritic spines in this region. To investigate this possibility, we trained male and female mice to nose poke for food reinforcers, or we delivered the same number of food reinforcers non-contingently to separate mice. We then decreased the likelihood of reinforcement for trained mice, requiring them to modify action-outcome expectations. In a separate experiment, we blocked action-outcome updating via chemogenetic inactivation of the OFC. In both cases, successfully selecting actions based on their likely consequences was associated with fewer immature, thin-shaped dendritic spines and a greater proportion of mature, mushroom-shaped spines in the ventrolateral OFC. This pattern was distinct from spine loss associated with aging, and we identified no effects on hippocampal CA1 neurons. Given that the OFC is involved in prospective calculations of likely outcomes, even when they are not observable, constraining spinogenesis while preserving mature spines may be important for solidifying durable expectations. To investigate causal relationships, we inhibited the RNA-binding protein fragile X mental retardation protein (encoded by Fmr1), which constrains dendritic spine turnover. Ventrolateral OFC-selective Fmr1 knockdown recapitulated the behavioral effects of inducible OFC inactivation (and lesions; also shown here), impairing action-outcome conditioning, and caused dendritic spine excess. Our findings suggest that a proper balance of dendritic spine plasticity within the OFC is necessary for one's ability to select actions based on anticipated consequences.SIGNIFICANCE STATEMENT Navigating a changing environment requires associating actions with their likely outcomes and updating these associations when they change. Dendritic spine plasticity is likely involved, yet relationships are unconfirmed. Using behavioral, chemogenetic, and viral-mediated gene silencing strategies and high-resolution microscopy, we find that modifying action-outcome expectations is associated with fewer immature spines and a greater proportion of mature spines in the ventrolateral orbitofrontal cortex (OFC). Given that the OFC is involved in prospectively calculating the likely outcomes of one's behavior, even when they are not observable, constraining spinogenesis while preserving mature spines may be important for maintaining durable expectations.

Metabotropic glutamate receptor subtype 3 gates acute stress-induced dysregulation of amygdalo-cortical function

Stress can precipitate or worsen symptoms of many psychiatric disorders by dysregulating glutamatergic function within the prefrontal cortex (PFC). Previous studies suggest that antagonists of group II metabotropic glutamate (mGlu) receptors (mGlu₂ and mGlu₃) reduce stress-induced anhedonia through actions in the PFC, but the mechanisms by which these receptors act are not known. We now report that activation of mGlu₃ induces long-term depression (LTD) of excitatory transmission in the PFC at inputs from the basolateral amygdala. Our data suggest mGlu₃-LTD is mediated by postsynaptic AMPAR internalization in PFC pyramidal cells, and we observed a profound impairment in mGlu₃-LTD following a single, 20-min restraint stress exposure. Finally, blocking mGlu₃ activation in vivo prevented the stress-induced maladaptive changes to amydalo-cortical physiology and motivated behavior. These data demonstrate that mGlu₃ mediates stress-induced physiological and behavioral impairments and further support the potential for mGlu₃ modulation as a treatment for stress-related psychiatric disorders.

Rho-kinase inhibition has antidepressant-like efficacy and expedites dendritic spine pruning in adolescent mice

Adolescence represents a critical period of neurodevelopment, defined by structural and synaptic pruning within the prefrontal cortex. While characteristic of typical development, this structural instability may open a window of vulnerability to developing neuropsychiatric disorders, including depression. Thus, therapeutic interventions that support or expedite neural remodeling in adolescence may be advantageous. Here, we inhibited the neuronally-expressed cytoskeletal regulatory factor Rho-kinase (ROCK), focusing primarily on the clinically-viable ROCK inhibitor fasudil. ROCK inhibition had rapid antidepressant-like effects in adolescent mice, and its efficacy was comparable to ketamine and fluoxetine. It also modified levels of the antidepressant-related signaling factors, tropomyosin/tyrosine receptor kinase B and Akt, as well as the postsynaptic marker PSD-95, in the ventromedial prefrontal cortex (vmPFC). Meanwhile, adolescent-typical dendritic spine pruning on excitatory pyramidal neurons in the vmPFC was expedited. Further, vmPFC-specific shRNA-mediated reduction of ROCK2, the dominant ROCK isoform in the brain, had antidepressant-like consequences. We cautiously suggest that ROCK inhibitors may have therapeutic potential for adolescent-onset depression.

Impulsive Action and Impulsive Choice Are Differentially Associated With Gene Expression Variations of the GABAA Receptor Alfa 1 Subunit and the CB1 Receptor in the Lateral and Medial Orbitofrontal Cortices

The orbitofrontal cortex (OFC) is a key brain region for decision-making, action control and impulsivity. Quite notably, previous research has identified a double dissociation regarding the role of this cortical territory in impulsive choice. While medial orbitofrontal lesions increase preference for a large but delayed reward, lateral orbitofrontal lesions have the opposite effect. However, there are no data regarding this anatomical dissociation in impulsive action. The neurochemical basis of impulsivity is still being elucidated, however, in recent years a role for the endocannabinoids and the related glutamatergic and GABAergic neurotransmitter systems has been suggested. Here, we submitted male Wistar rats to a delay-discounting task (DDT) or a two-choice serial reaction time task (2-CSRTT) and classified them as high impulsive or low impulsive in either task using cluster analysis. We then examined the gene expression of several elements of the endocannabinoid system or different subunits of certain glutamatergic or GABAergic ionotropic receptors (AMPA, NMDA, or GABA_A) in the lateral or medial divisions of their orbitofrontal cortices. Our results confirm, at the gene expression level, the dissociation in the participation of the medial, and lateral divisions of the orbitofrontal cortex in impulsivity. While in the 2-CSRTT (inhibitory control) we found that high impulsive animals exhibited lower gene expression levels of the α1 GABA_A receptor subunit in the lateral OFC, no such differences were evident in the medial OFC. When we analyzed DDT performance, we found that high impulsive animals displayed lower levels of CB₁ gene expression in the medial but not in the lateral OFC. We propose that GABAergic dynamics in the lateral OFC might contribute to the inhibitory control mechanisms that are altered in impulsive behavior while endocannabinoid receptor gene transcription in the medial OFC may subserve the delay-discounting processes that participate in certain types of impulsiveness.

Bi-directional modulation of food habit expression by the endocannabinoid system

The compulsive, habitual behaviors that have been observed in individuals diagnosed with substance use disorders may be due to disruptions in the neural circuits that mediate goal-directed actions. The endocannabinoid system has been shown to play a critical role in habit learning, but the role of this neuromodulatory system in habit expression is unclear. Here, we investigated the role of the endocannabinoid system in established habitual actions using contingency degradation in male C57BL/6 mice. We found that administration of the endocannabinoid transport inhibitor AM404 reduced habitual responding for food and that antagonism of cannabinoid receptor type 1 (CB1), but not transient receptor potential cation subfamily V (TRPV1), receptors produced a similar reduction in habitual responding. Moreover, pharmacological stimulation of CB1 receptors increased habitual responding for food. Co-administration of an enzyme inhibitor that selectively increases the endocannabinoid 2-arachidonoyl glycerol (2-AG) with AM404 partially restored habitual responding for food. Together, these findings demonstrate an important role for the endocannabinoid system in the expression of habits and provide novel insights into potential pharmacological strategies for reducing habitual behaviors in mental disorders.

The role of the orbitofrontal cortex in alcohol use, abuse, and dependence

One of the major functions of the orbitofrontal cortex (OFC) is to promote flexible motivated behavior. It is no surprise, therefore, that recent work has demonstrated a prominent impact of chronic drug use on the OFC and a potential role for OFC disruption in drug abuse and addiction. Among drugs of abuse, the use of alcohol is particularly salient with respect to OFC function. Although a number of studies in humans have implicated OFC dysregulation in alcohol use disorders, animal models investigating the association between OFC and alcohol use are only beginning to be developed, and there is still a great deal to be revealed. The goal of this review is to consider what is currently known regarding the role of the OFC in alcohol use and dependence. I will first provide a brief, general overview of current views of OFC function and its contributions to drug seeking and addiction. I will then discuss research to date related to the OFC and alcohol use, both in human clinical populations and in non-human models. Finally I will consider issues and strategies to guide future study that may identify this brain region as a key player in the transition from moderated to problematic alcohol use and dependence.

Behavioral and neural mechanisms underlying habitual and compulsive drug seeking

Addiction is characterized by compulsive drug use despite negative consequences. Here we review studies that indicate that compulsive drug use, and in particular punishment resistance in animal models of addiction, is related to impaired cortical control over habitual behavior. In humans and animals, instrumental behavior is supported by goal-directed and habitual systems that rely on distinct corticostriatal networks. Chronic exposure to addictive drugs or stress has been shown to bias instrumental response strategies toward habit learning, and impair prefrontal cortical (PFC) control over responding. Moreover, recent work has implicated prelimbic PFC hypofunction in the punishment resistance that has been observed in a subset of animals with an extended history of cocaine self-administration. This may be related to a broader role for prelimbic PFC in mediating adaptive responding and behavioral flexibility, including exerting goal-directed control over behavior. We hypothesize that impaired cortical control and reduced flexibility between habitual and goal-directed systems may be critically involved in the development of maladaptive, compulsive drug use.

Inactivation of ventral hippocampus projections promotes sensitivity to changes in contingency

The loss of behavioral flexibility is common across a number of neuropsychiatric illnesses. This may be in part due to the loss of the ability to detect or use changes in action–outcome contingencies to guide behavior. There is growing evidence that the ventral hippocampus plays a critical role in the regulation of flexible behavior and reward-related decision making. Here, we investigated the role of glutamatergic projections from the ventral hippocampus in the expression of contingency-mediated reward seeking. We demonstrate that selectively silencing ventral hippocampus projections can restore the use of action–outcome contingencies to guide behavior, while sparing cue-guided behavior and extinction learning. Our findings further indicated that the ability of the ventral hippocampus to promote habitual response strategies may be in part mediated by selective projections from the ventral hippocampus to the nucleus accumbens shell. Together these results implicate glutamatergic projections from the ventral hippocampus in the regulation of behavioral flexibility and suggest that alterations in ventral hippocampus function may contribute to overreliance on habitual response strategy observed in neuropsychiatric illnesses including addiction and obsessive–compulsive disorder.

Mechanisms underlying prelimbic prefrontal cortex mGlu3/mGlu5-dependent plasticity and reversal learning deficits following acute stress

Stress can precipitate or worsen symptoms of many psychiatric illnesses. Dysregulation of the prefrontal cortex (PFC) glutamate system may underlie these disruptions and restoring PFC glutamate signaling has emerged as a promising avenue for the treatment of stress disorders. Recently, we demonstrated that activation of metabotropic glutamate receptor subtype 3 (mGlu₃) induces a postsynaptic form of long-term depression (LTD) that is dependent on the activity of another subtype, mGlu₅. Stress exposure disrupted this plasticity, but the underlying signaling mechanisms and involvement in higher-order cognition have not yet been investigated. Acute stress was applied by 20-min restraint and early reversal learning was evaluated in an operant-based food-seeking task. We employed whole-cell patch-clamp recordings of layer 5 prelimbic (PL)-PFC pyramidal cells to examine mGlu₃-LTD and several mechanistically distinct mGlu₅-dependent functions. Acute stress impaired both mGlu₃-LTD and early reversal learning. Interestingly, potentiating mGlu₅ signaling with the mGlu₅ positive allosteric modulator (PAM) VU0409551 rescued stress-induced deficits in both mGlu₃-LTD and reversal learning. Other aspects of PL-PFC mGlu₅ function were not disrupted following stress; however, signaling downstream of mGlu₅-Homer interactions, phosphoinositide-3-kinase (PI3K), Akt, and glycogen synthase kinase 3β was implicated in these phenomena. These findings demonstrate that acute stress disrupts early reversal learning and PL-PFC-dependent synaptic plasticity and that potentiating mGlu₅ function can restore these impairments. These findings provide a framework through which modulating coordinated mGlu₃/mGlu₅ signaling may confer benefits for the treatment of stress-related psychiatric disorders.

Medial orbitofrontal inactivation does not affect economic choice

How are decisions made between different goods? One theory spanning several fields of neuroscience proposes that their values are distilled to a single common neural currency, the calculation of which allows for rational decisions. The orbitofrontal cortex (OFC) is thought to play a critical role in this process, based on the presence of neural correlates of economic value in lateral OFC in monkeys and medial OFC in humans. We previously inactivated lateral OFC in rats without affecting economic choice behavior. Here we inactivated medial OFC in the same task, again without effect. Behavior in the same rats was disrupted by inactivation during progressive ratio responding previously shown to depend on medial OFC, demonstrating the efficacy of the inactivation. These results indicate that medial OFC is not necessary for economic choice, bolstering the proposal that classic economic choice is likely mediated by multiple, overlapping neural circuits.

Oxygen responses within the nucleus accumbens are associated with individual differences in effort exertion in rats

Goal‐directed motivated behaviour is crucial for everyday life. Such behaviour is often measured, in rodents, under a progressive ratio (PR) schedule of reinforcement. Previous studies have identified a few brain structures critical for supporting PR performance. However, the association between neural activity within these regions and individual differences in effort‐related behaviour is not known. Presently, we used constant potential in vivo oxygen amperometry, a surrogate for functional resonance imaging in rodents, to assess changes in tissue oxygen levels within the nucleus accumbens (NAc) and orbitofrontal cortex (OFC) in male Wistar rats performing a PR task. Within both regions, oxygen responses to rewards increased as the effort exerted to obtain the rewards was larger. Furthermore, higher individual breakpoints were associated with greater magnitude NAc oxygen responses. This association could not be explained by temporal confounds and remained significant when controlling for the different number of completed trials. Animals with higher breakpoints also showed greater magnitude NAc oxygen responses to rewards delivered independently of any behaviour. In contrast, OFC oxygen responses were not associated with individual differences in behavioural performance. The present results suggest that greater NAc oxygen responses following rewards, through a process of incentive motivation, may allow organisms to remain on task for longer and to overcome greater effort costs.

An approach to monitoring home-cage behavior in mice that facilitates data sharing

Genetically modified mice are used as models for a variety of human behavioral conditions. However, behavioral phenotyping can be a major bottleneck in mouse genetics because many of the classic protocols are too long and/or are vulnerable to unaccountable sources of variance, leading to inconsistent results between centers. We developed a home-cage approach using a Chora feeder that is controlled by-and sends data to-software. In this approach, mice are tested in the standard cages in which they are held for husbandry, which removes confounding variables such as the stress induced by out-of-cage testing. This system increases the throughput of data gathering from individual animals and facilitates data mining by offering new opportunities for multimodal data comparisons. In this protocol, we use a simple work-for-food testing strategy as an example application, but the approach can be adapted for other experiments looking at, e.g., attention, decision-making or memory. The spontaneous behavioral activity of mice in performing the behavioral task can be monitored 24 h a day for several days, providing an integrated assessment of the circadian profiles of different behaviors. We developed a Python-based open-source analytical platform (Phenopy) that is accessible to scientists with no programming background and can be used to design and control such experiments, as well as to collect and share data. This approach is suitable for large-scale studies involving multiple laboratories.

Adult neurogenesis affects motivation to obtain weak, but not strong, reward in operant tasks

Decreased motivation to seek rewards is a key feature of mood disorders that correlates with severity and treatment outcome. This anhedonia, or apathy, likely reflects impairment in reward circuitry, but the specific neuronal populations controlling motivation are unclear. Granule neurons generated in the adult hippocampus have been implicated in mood disorders, but are not generally considered as part of reward circuits. We investigated a possible role of these new neurons in motivation to work for food and sucrose rewards in operant conditioning tasks using GFAP-TK pharmacogenetic ablation of adult neurogenesis in both rats and mice. Rats and mice lacking adult neurogenesis showed normal lever press responding during fixed ratio training, reward devaluation, and Pavlovian Instrumental Transfer, suggesting no impairment in learning. However, on an exponentially progressive ratio schedule, or when regular chow was freely available in the testing chamber, TK rats and mice showed less effort to gain sucrose tablets. When working for balanced food tablets, which rats and mice of both genotypes strongly preferred over sucrose, the genotype effects on behavior were lost. This decrease in effort under conditions of low reward suggests that loss of adult neurogenesis decreases motivation to seek reward in a manner that may model behavioral apathy.

Neuropsychiatric Phenotypes Produced by GABA Reduction in Mouse Cortex and Hippocampus

Whereas cortical GAD67 reduction and subsequent GABA level decrease are consistently observed in schizophrenia and depression, it remains unclear how these GABAergic abnormalities contribute to specific symptoms. We modeled cortical GAD67 reduction in mice, in which the Gad1 gene is genetically ablated from ~50% of cortical and hippocampal interneurons. Mutant mice showed a reduction of tissue GABA in the hippocampus and cortex including mPFC, and exhibited a cluster of effort-based behavior deficits including decreased home-cage wheel running and increased immobility in both tail suspension and forced swim tests. Since saccharine preference, progressive ratio responding to food, and learned helplessness task were normal, such avolition-like behavior could not be explained by anhedonia or behavioral despair. In line with the prevailing view that dopamine in anterior cingulate cortex (ACC) plays a role in evaluating effort cost for engaging in actions, we found that tail-suspension triggered dopamine release in ACC of controls, which was severely attenuated in the mutant mice. Conversely, ACC dopamine release by progressive ratio responding to reward, during which animals were allowed to effortlessly perform the nose-poking, was not affected in mutants. These results suggest that cortical GABA reduction preferentially impairs the effort-based behavior which requires much effort with little benefit, through a deficit of ACC dopamine release triggered by high-effort cost behavior, but not by reward-seeking behavior. Collectively, a subset of negative symptoms with a reduced willingness to expend costly effort, often observed in patients with schizophrenia and depression, may be attributed to cortical GABA level reduction.

A Novel Role for Oligodendrocyte Precursor Cells (OPCs) and Sox10 in Mediating Cellular and Behavioral Responses to Heroin

Opiate abuse and addiction have become a worldwide epidemic with great societal and financial burdens, highlighting a critical need to understand the neurobiology of opiate addiction. Although several studies have focused on drug-dependent changes in neurons, the role of glia in opiate addiction remains largely unstudied. RNA sequencing pathway analysis from the prefrontal cortex (PFC) of male rats revealed changes in several genes associated with oligodendrocyte differentiation and maturation following heroin self-administration. Among these genes changed was Sox10, which is regulated, in part, by the chromatin remodeler BRG1/SMARCA4. To directly test the functional role of Sox10 in mediating heroin-induced behavioral plasticity, we selectively overexpressed Sox10 and BRG1 in the PFC. Overexpression of either Sox10 or BRG1 decreased the motivation to obtain heroin infusions in a progressive ratio test without altering the acquisition or maintenance of heroin self-administration. These data demonstrate a critical, and perhaps compensatory, role of Sox10 and BRG1 in oligodendrocytes in regulating the motivation for heroin.

Adolescent Corticosterone and TrkB Pharmaco-Manipulations Sex-Dependently Impact Instrumental Reversal Learning Later in Life

Early-life trauma can increase the risk for, and severity of, several psychiatric illnesses. These include drug use disorders, and some correlations appear to be stronger in women. Understanding the long-term consequences of developmental stressor or stress hormone exposure and possible sex differences is critically important. So-called “reversal learning” tasks are commonly used in rodents to model cognitive deficits in stress- and addiction-related illnesses in humans. Here, we exposed mice to the primary stress hormone corticosterone (CORT) during early adolescence (postnatal days 31–42), then tested behavioral flexibility in adulthood using an instrumental reversal learning task. CORT-exposed female, but not male, mice developed perseverative errors. Despite resilience to subchronic CORT exposure, males developed reversal performance impairments following exposure to physical stressors. Administration of a putative tyrosine kinase receptor B (trkB) agonist, 7,8-dihydroxyflavone (7,8-DHF), during adolescence blocked CORT-induced errors in females and improved performance in males. Conversely, blockade of trkB by ANA-12 impaired performance. These data suggest that trkB-based interventions could have certain protective benefits in the context of early-life stressor exposure. We consider the implications of our findings in an extended “Discussion” section.