Orbital frontal cortex updates state-induced value change for decision-making

A ventral pallidal-thalamocortical circuit mediates the cognitive control of instrumental action

Predictive learning can engage a selective form of cognitive control that biases choice between actions based on information about future outcomes that the learning provides. This influence has been hypothesized to depend on a feedback circuit in the brain through which the basal ganglia modulate activity in the prefrontal cortex; however, direct evidence for this functional circuit has proven elusive. Here, using an animal model of cognitive control, we found that the influence of predictive learning on decision making is mediated by an inhibitory feedback circuit linking the medial ventral pallidum and the mediodorsal thalamus, the activation of which causes disinhibition of the orbitofrontal cortex via reduced activation of inhibitory parvalbumin interneurons during choice. Thus, we found that, for this function, the mediodorsal thalamus serves as a pallidal-cortical relay through which predictive learning controls action selection, which has important implications for understanding cognitive control and its vicissitudes in various psychiatric disorders and addiction.

Pathways to the persistence of drug use despite its adverse consequences

The persistence of drug taking despite its adverse consequences plays a central role in the presentation, diagnosis, and impacts of addiction. Eventual recognition and appraisal of these adverse consequences is central to decisions to reduce or cease use. However, the most appropriate ways of conceptualizing persistence in the face of adverse consequences remain unclear. Here we review evidence that there are at least three pathways to persistent use despite the negative consequences of that use. A cognitive pathway for recognition of adverse consequences, a motivational pathway for valuation of these consequences, and a behavioral pathway for responding to these adverse consequences. These pathways are dynamic, not linear, with multiple possible trajectories between them, and each is sufficient to produce persistence. We describe these pathways, their characteristics, brain cellular and circuit substrates, and we highlight their relevance to different pathways to self- and treatment-guided behavior change.

Whole-brain mapping of long-range inputs to the VIP-expressing inhibitory neurons in the primary motor cortex

The primary motor cortex (MOp) is an important site for motor skill learning. Interestingly, neurons in MOp possess reward-related activity, presumably to facilitate reward-based motor learning. While pyramidal neurons (PNs) and different subtypes of GABAergic inhibitory interneurons (INs) in MOp all undergo cell-type specific plastic changes during motor learning, the vasoactive intestinal peptide-expressing inhibitory interneurons (VIP-INs) in MOp have been shown to preferentially respond to reward and play a critical role in the early phases of motor learning by triggering local circuit plasticity. To understand how VIP-INs might integrate various streams of information, such as sensory, pre-motor, and reward-related inputs, to regulate local plasticity in MOp, we performed monosynaptic rabies tracing experiments and employed an automated cell counting pipeline to generate a comprehensive map of brain-wide inputs to VIP-INs in MOp. We then compared this input profile to the brain-wide inputs to somatostatin-expressing inhibitory interneurons (SST-INs) and parvalbumin-expressing inhibitory interneurons (PV-INs) in MOp. We found that while all cell types received major inputs from sensory, motor, and prefrontal cortical regions, as well as from various thalamic nuclei, VIP-INs received more inputs from the orbital frontal cortex (ORB) - a region associated with reinforcement learning and value predictions. Our findings provide insight on how the brain leverages microcircuit motifs by both integrating and partitioning different streams of long-range input to modulate local circuit activity and plasticity.

The role of the lateral orbitofrontal cortex in creating cognitive maps

We use mental models of the world-cognitive maps-to guide behavior. The lateral orbitofrontal cortex (lOFC) is typically thought to support behavior by deploying these maps to simulate outcomes, but recent evidence suggests that it may instead support behavior by underlying map creation. We tested between these two alternatives using outcome-specific devaluation and a high-potency chemogenetic approach. Selectively inactivating lOFC principal neurons when male rats learned distinct cue-outcome associations, but before outcome devaluation, disrupted subsequent inference, confirming a role for the lOFC in creating new maps. However, lOFC inactivation surprisingly led to generalized devaluation, a result that is inconsistent with a complete mapping failure. Using a reinforcement learning framework, we show that this effect is best explained by a circumscribed deficit in credit assignment precision during map construction, suggesting that the lOFC has a selective role in defining the specificity of associations that comprise cognitive maps.

The ventrolateral prefrontal cortex is part of the modular working memory system: A functional neuroanatomical perspective

For many years, the functional role of the ventrolateral Pre-Frontal Cortex (PFC) was associated with executive functions, specifically in the context of non-affective cognitive processes. However, recent research has suggested that the ventrolateral PFC is also involved in the attention system. The Ben Shalom model of the functional organization of the prefrontal cortex (2019) posits that the ventrolateral PFC selects perceptual stimuli after integration by the adjacent ventromedial PFC. This article reviews the state-of-the-art findings to better understand the role of the ventrolateral PFC in the selection of perceptual information as grounded in the Ben Shalom model. Numerous studies have reported converging evidence for the selective role of this area. However, most argue that this perceptual selection takes place through the active updating of information values linked to goal-oriented actions. These studies thus view the ventrolateral PFC as part of a system that actively manipulates and changes processed information such as the working memory function, rather than being part of the attention system. In agreement with this view, this review suggests that this area is part of a complex and modular working memory system and illustrates with reference to Diamond's work on ADD. This working memory system is functionally and anatomically dispersed and includes the dorsolateral PFC, the ACC, the parietal cortex, the basal ganglia, and the cerebellum. Hence, future research should continue to explore the specific neurofunctional roles of these areas in working memory systems, and the connections between the different subareas in this complex array.

Orbitofrontal cortex populations are differentially recruited to support actions

The ability to use information from one's prior actions is necessary for decision-making. While orbitofrontal cortex (OFC) has been hypothesized as key for inferences made using cue and value-related information, whether OFC populations contribute to the use of information from volitional actions to guide behavior is not clear. Here, we used a self-paced lever-press hold-down task in which mice infer prior lever-press durations to guide subsequent action performance. We show that the activity of genetically identified lateral OFC (lOFC) subpopulations differentially instantiate current and prior action information during ongoing action execution. Transient state-dependent lOFC circuit disruptions of specified subpopulations reduced the encoding of ongoing press durations but did not disrupt the use of prior action information to guide future action performance. In contrast, a chronic functional loss of lOFC circuit activity resulted in increased reliance on recently executed lever-press durations and impaired contingency reversal, suggesting the recruitment of compensatory mechanisms that resulted in repetitive action control. Our results identify a novel role for lOFC in the integration of action information to guide adaptive behavior.

Effects of central amygdala chemogenetic manipulation and prior chronic alcohol exposure on Pavlovian-to-instrumental transfer

BACKGROUND

Recent work suggests that a history of chronic alcohol exposure can enhance the influence of nondrug reward cues on ongoing actions. This is often modeled in Pavlovian-to-instrumental transfer (PIT) tasks that examine the interaction between Pavlovian and instrumental learning processes, usually reflected as an increase in action vigor during the presentation of a reward-associated cue. Though prior chronic alcohol exposure strengthens this type of cue-guided behavior, the neural mechanisms underlying such enhancements are not known.

METHODS

In the present work, we examined the contribution of the central amygdala (CeA), a region strongly implicated in PIT behaviors and functionally altered by chronic alcohol exposure. We utilized Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) to examine the impact of inhibitory and excitatory CeA manipulation on PIT behaviors in alcohol-naïve mice and mice with a history of chronic intermittent ethano vapor exposure and withdrawal (CIE).

RESULTS

Replicating previous work, we found that a history of CIE strengthened baseline PIT, in the absence of any CeA manipulation. We also found that activation of both inhibitory and excitatory DREADDs expressed in CeA enhanced PIT in alcohol-naïve mice, though the latter markedly reduced response rates. However, in mice exposed to CIE, activation of excitatory DREADD receptors expressed in CeA appeared to weaken PIT.

CONCLUSIONS

These results suggest that alcohol-induced disruptions in amygdala function may contribute to changes in appetitive behaviors, such as cue-guided responding, following chronic exposure to alcohol. Better elucidating the neural mechanisms that underlie disrupted cue-guided behavior following chronic alcohol exposure may help to understand and treat deficits in adaptive behavior associated with chronic alcohol use in humans.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

Effects of chronic alcohol exposure on motivation-based value updating

Dysfunctional decision-making has been observed in alcohol dependence. However, the specific underlying processes disrupted have yet to be identified. Important to goal-directed decision-making is one's motivational state, which is used to update the value of actions. As ethanol dependence disrupts decision-making processes, we hypothesized that ethanol dependence could alter sensitivity to motivational state and/or value updating, thereby reducing the capability for adaptive behavior. Here we employed a sequential instrumental learning task to examine this hypothesis. In two experiments, mice underwent chronic intermittent ethanol (CIE) or air (Air) vapor exposure and repeated withdrawal procedures to induce ethanol dependence. Mice were then trained on a sequence of distal and proximal lever pressing for sucrose under either mild or more severe food restriction. Half of all Air and CIE mice then underwent a motivational shift to a less hungry state and effects of this motivational shift were evaluated across three days. First, mice were re-exposed to sucrose, and effects of food restriction state and CIE exposure on lick and consummatory behavior were examined in the absence of lever pressing. Over the next two days, mice underwent a brief non-rewarded test and then a rewarded test where the ability to retrieve and infer sucrose value to guide lever pressing was measured. In the sucrose re-exposure session, prior CIE exposure altered sucrose-seeking in mice with a history of mild but not more severe food restriction, suggesting altered motivational sensitivity. During lever press testing, CIE mice were insensitive to decreases in motivational state and did not reduce proximal lever pressing regardless of food restriction state. Mildly restricted CIE mice, but not severely restricted CIE mice, also did not reduce distal pressing to the same degree as Air mice following a downshift in motivational state. Our findings suggest that ethanol dependence may disrupt motivational processes supporting value updating that are important for decision-making.

A bidirectional corticoamygdala circuit for the encoding and retrieval of detailed reward memories

Adaptive reward-related decision making often requires accurate and detailed representation of potential available rewards. Environmental reward-predictive stimuli can facilitate these representations, allowing one to infer which specific rewards might be available and choose accordingly. This process relies on encoded relationships between the cues and the sensory-specific details of the rewards they predict. Here, we interrogated the function of the basolateral amygdala (BLA) and its interaction with the lateral orbitofrontal cortex (lOFC) in the ability to learn such stimulus-outcome associations and use these memories to guide decision making. Using optical recording and inhibition approaches, Pavlovian cue-reward conditioning, and the outcome-selective Pavlovian-to-instrumental transfer (PIT) test in male rats, we found that the BLA is robustly activated at the time of stimulus-outcome learning and that this activity is necessary for sensory-specific stimulus-outcome memories to be encoded, so they can subsequently influence reward choices. Direct input from the lOFC was found to support the BLA in this function. Based on prior work, activity in BLA projections back to the lOFC was known to support the use of stimulus-outcome memories to influence decision making. By multiplexing optogenetic and chemogenetic inhibition we performed a serial circuit disconnection and found that the lOFC→BLA and BLA→lOFC pathways form a functional circuit regulating the encoding (lOFC→BLA) and subsequent use (BLA→lOFC) of the stimulus-dependent, sensory-specific reward memories that are critical for adaptive, appetitive decision making.

Cortico-cortical connectivity behind acoustic information transfer to mouse orbitofrontal cortex is sensitive to neuromodulation and displays local sensory gating: relevance in disorders with auditory hallucinations?

BACKGROUND

Auditory hallucinations (which occur when the distinction between thoughts and perceptions is blurred) are common in psychotic disorders. The orbitofrontal cortex (OFC) may be implicated, because it receives multiple inputs, including sound and affective value via the amygdala, orchestrating complex emotional responses. We aimed to elucidate the circuit and neuromodulatory mechanisms that underlie the processing of emotionally salient auditory stimuli in the OFC — mechanisms that may be involved in auditory hallucinations.

METHODS

We identified the cortico-cortical connectivity conveying auditory information to the mouse OFC; its sensitivity to neuromodulators involved in psychosis and postpartum depression, such as dopamine and neurosteroids; and its sensitivity to sensory gating (defective in dysexecutive syndromes).

RESULTS

Retrograde tracers in OFC revealed input cells in all auditory cortices. Acoustic responses were abolished by pharmacological and chemogenetic inactivation of the above-identified pathway. Acoustic responses in the OFC were reduced by local dopaminergic agonists and neurosteroids. Noticeably, apomorphine action lasted longer in the OFC than in auditory areas, and its effect was modality-specific (augmentation for visual responses), whereas neurosteroid action was sex-specific. Finally, acoustic responses in the OFC reverberated to the auditory association cortex via feedback connections and displayed sensory gating, a phenomenon of local origin, given that it was not detectable in input auditory cortices.

LIMITATIONS

Although our findings were for mice, connectivity and sensitivity to neuromodulation are conserved across mammals.

CONCLUSION

The corticocortical loop from the auditory association cortex to the OFC is dramatically sensitive to dopamine and neurosteroids. This suggests a clinically testable circuit behind auditory hallucinations. The function of OFC input–output circuits can be studied in mice with targeted and clinically relevant mutations related to their response to emotionally salient sounds.

The mouse prefrontal cortex: Unity in diversity

The prefrontal cortex (PFC) is considered to constitute the highest stage of neural integration and to be devoted to representation and production of actions. Studies in primates have laid the foundation for theories regarding the principles of prefrontal function and provided mechanistic insights. The recent surge of studies of the PFC in mice holds promise for evolvement of present theories and development of novel concepts, particularly regarding principles shared across mammals. Here we review recent empirical work on the mouse PFC capitalizing on the experimental toolbox currently privileged to studies in this species. We conclude that this line of research has revealed cellular and structural distinctions of the PFC and neuronal activity with direct relevance to theories regarding the functions of the PFC. We foresee that data-rich mouse studies will be key to shed light on the general prefrontal architecture and mechanisms underlying cognitive aspects of organized actions.

Different Effects of Alcohol Exposure on Action and Outcome-Related Orbitofrontal Cortex Activity

Alcohol dependence can result in long-lasting deficits to decision-making and action control. Neurobiological investigations have identified orbitofrontal cortex (OFC) as important for outcome-related contributions to goal-directed actions during decision-making. Prior work has shown that alcohol dependence induces long-lasting changes to OFC function that persist into protracted withdrawal and disrupts goal-directed control over actions. However, it is unclear whether these changes in function alter representation of action and outcome-related neural activity in OFC. Here, we used the well-validated chronic intermittent ethanol (CIE) exposure and withdrawal procedure to model alcohol dependence in mice and performed in vivo extracellular recordings during an instrumental task in which lever-press actions made for a food outcome. We found alcohol dependence disrupted goal-directed action control and increased OFC activity associated with lever-pressing but decreased OFC activity during outcome-related epochs. The ability to decode outcome-related information, but not action information, from OFC activity following CIE exposure was reduced. Hence, chronic alcohol exposure induced a long-lasting disruption to OFC function such that activity associated with actions was enhanced, but OFC activity contributions to outcome-related information was diminished. This has important implications for hypotheses regarding compulsive and habitual phenotypes observed in addiction.

A Neural Mechanism of Cue-Outcome Expectancy Generated by the Interaction Between Orbitofrontal Cortex and Amygdala

Taste perception is important for animals to take adequate nutrients and avoid toxins for their survival. Appetitive and aversive behaviors are produced by value evaluation of taste and taste expectation caused by other sensations. The value evaluation, coupled with a cue presentation, produces outcome expectation and guides flexible behaviors when the environment is changed. Experimental studies demonstrated distinct functional roles of basolateral amygdala (ABL) and orbitofrontal cortex (OFC) in value evaluation and adaptive behavior. ABL is involved in generating a cue-outcome association, whereas OFC makes a contribution of generating a cue-triggered expectation to guide adaptive behavior. However, it remains unclear how ABL and OFC form their functional roles, with the learning of adaptive behavior. To address this issue, we focus on an odor discrimination task of rats and develop a computational model that consists of OFC and ABL, interacting with reward and decision systems. We present the neural mechanisms underlying the rapid formation of cue-outcome association in ABL and late behavioral adaptation mediated by OFC. Moreover, we offer 2 functions of cue-selective neurons in OFC: one is that the activation of cue-selective neurons transmits value information to decision area to guide behavior and another is that persistent activity of cue-selective neurons evokes a weak activity of taste-sensitive OFC neurons, leading to cue-outcome expectation. Our model further accounts for ABL and OFC responses caused by lesions of these areas. The results provide a computational framework of how ABL and OFC are functionally linked through their interactions with the reward and decision systems.

Call for a more balanced approach to understanding orbital frontal cortex function

Orbital frontal cortex (OFC) research has historically emphasized the function of this associative cortical area within top-down theoretical frameworks. This approach has largely focused on mapping OFC activity onto human-defined psychological or cognitive constructs and has often led to OFC circuitry bearing the weight of entire theoretical frameworks. New techniques and tools developed in the last decade have made it possible to revisit long-standing basic science questions in neuroscience and answer them with increasing sophistication. We can now study and specify the genetic, molecular, cellular, and circuit architecture of a brain region in much greater detail, which allows us to piece together how they contribute to emergent circuit functions. For instance, adopting such systematic and unbiased bottom-up approaches to elucidating the function of the visual system has paved the way to building a greater understanding of the spectrum of its computational capabilities. In the same vein, we argue that OFC research would benefit from a more balanced approach that also places focus on novel bottom-up investigations into OFC's computational capabilities. Furthermore, we believe that the knowledge gained by employing a more bottom-up approach to investigating OFC function will ultimately allow us to look at OFC's dysfunction in disease through a more nuanced biological lens. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Parafascicular Thalamic and Orbitofrontal Cortical Inputs to Striatum Represent States for Goal-Directed Action Selection

Several lines of evidence accrued over the last 5–10 years have converged to suggest that the parafascicular nucleus of the thalamus and the lateral orbitofrontal cortex each represent or contribute to internal state/context representations that guide action selection in partially observable task situations. In rodents, inactivations of each structure have been found to selectively impair performance in paradigms testing goal-directed action selection, but only when that action selection relies on state representations. Electrophysiological evidence has suggested that each structure achieves this function via inputs onto cholinergic interneurons (CINs) in the dorsomedial striatum. Here, we briefly review these studies, then point to anatomical evidence regarding the afferents of each structure and what they suggest about the specific features that each contribute to internal state representations. Finally, we speculate as to whether this role might be achieved interdependently through direct PF→OFC projections, or through the convergence of independent direct orbitofrontal cortex (OFC) and parafascicular nucleus of the thalamus (PF) inputs onto striatal targets.

Altered Activity of Lateral Orbitofrontal Cortex Neurons in Mice following Chronic Intermittent Ethanol Exposure

The lateral orbitofrontal cortex (LOFC) is thought to encode information associated with consumption of rewarding substances and is essential for flexible decision-making. Indeed, firing patterns of LOFC neurons are modulated following changes in reward value associated with an action outcome relationship. Damage to the LOFC impairs behavioral flexibility in humans and is associated with suboptimal performance in reward devaluation protocols in rodents. As chronic intermittent ethanol (CIE) exposure also impairs OFC-dependent behaviors, we hypothesized that CIE exposure would alter LOFC neuronal activity during alcohol drinking, especially under conditions when the reward value of ethanol was modulated by aversive or appetitive tastants. To test this hypothesis, we monitored LOFC activity using GCaMP6f fiber photometry in mice receiving acute injections of ethanol and in those trained in operant ethanol self-administration. In naive mice, an acute injection of ethanol caused a dose-dependent decrease in the frequency but not amplitude of GCaMP6f transients. In operant studies, mice were trained on a fixed ratio one schedule of reinforcement and were then separated into CIE or Air groups. Following four cycles of CIE exposure, GCaMP6f activity was recorded during self-administration of alcohol, alcohol+quinine (aversive), or alcohol+sucrose (appetitive) solutions. LOFC neurons showed discrete patterns of activity surrounding lever presses and surrounding drinking bouts. Responding for and consumption of ethanol was greatly enhanced by CIE exposure, was aversion resistant, and was associated with signs of LOFC hyperexcitability. CIE-exposed mice also showed altered patterns of LOFC activity that varied with the ethanol solution consumed.

Prior Cocaine Use Alters the Normal Evolution of Information Coding in Striatal Ensembles during Value-Guided Decision-Making

Substance use disorders (SUDs) are characterized by maladaptive behavior. The ability to properly adjust behavior according to changes in environmental contingencies necessitates the interlacing of existing memories with updated information. This can be achieved by assigning learning in different contexts to compartmentalized "states." Though not often framed this way, the maladaptive behavior observed in individuals with SUDs may result from a failure to properly encode states because of drug-induced neural alterations. Previous studies found that the dorsomedial striatum (DMS) is important for behavioral flexibility and state encoding, suggesting the DMS may be an important substrate for these effects. Here, we recorded DMS neural activity in cocaine-experienced male rats during a decision-making task where blocks of trials represented distinct states to probe whether the encoding of state and state-related information is affected by prior drug exposure. We found that DMS medium spiny neurons (MSNs) and fast-spiking interneurons (FSIs) encoded such information and that prior cocaine experience disrupted the evolution of representations both within trials and across recording sessions. Specifically, DMS MSNs and FSIs from cocaine-experienced rats demonstrated higher classification accuracy of trial-specific rules, defined by response direction and value, compared with those drawn from sucrose-experienced rats, and these overly strengthened trial-type representations were related to slower switching behavior and reaction times. These data show that prior cocaine experience paradoxically increases the encoding of state-specific information and rules in the DMS and suggest a model in which abnormally specific and persistent representation of rules throughout trials in DMS slows value-based decision-making in well trained subjects.SIGNIFICANCE STATEMENT Substance use disorders (SUDs) may result from a failure to properly encode rules guiding situationally appropriate behavior. The dorsomedial striatum (DMS) is thought to be important for such behavioral flexibility and encoding that defines the situation or "state." This suggests that the DMS may be an important substrate for the maladaptive behavior observed in SUDs. In the current study, we show that prior cocaine experience results in over-encoding of state-specific information and rules in the DMS, which may impair normal adaptive decision-making in the task, akin to what is observed in SUDs.

Roles of the prefrontal cortex in learning to time the onset of pre-existing motor programs

The prefrontal cortex (PFC) is involved in cognitive control of motor activities and timing of future intensions. This study investigated the cognitive control of balance recovery in response to unpredictable gait perturbations and the role of PFC subregions in learning by repetition. Bilateral dorsolateral (DLPFC), ventrolateral (VLPFC), frontopolar (FPFC) and orbitofrontal (OFC) cortex hemodynamic changes induced by unpredictable slips were analyzed as a function of successive trials in ten healthy young adults. Slips were induced by the acceleration of one belt as the participant walked on a split-belt treadmill. A portable functional near-infrared spectroscope monitored PFC activities quantified by oxyhemoglobin (ΔO₂Hb) and deoxyhemoglobin (ΔHbR) during the consecutive trial phases: standing, walking, slip-recovery. During the first 3 trials, the average oxyhemoglobin (ΔO₂Hb_avg) in the DLPFC, VLPFC, FPFC, and OFC cortex was significantly higher during slip-recovery than unperturbed walking or the standing baseline. Then, ΔO₂Hb_avg decreased progressively from trial-to-trial in the DLPFC, VLPFC, and FPFC, but increased and then remained constant in the OFC. The average deoxyhemoglobin (ΔHbR_avg) presented mirror patterns. These changes after the third trial were paralleled by the progressive improvement of recovery revealed by kinematic variables. The results corroborate our previous hypothesis that only timing of the onset of a “good enough recovery motor program” is learned with practice. They also strongly support the assumption that the PFC contributes to the recall of pre-existing motor programs whose onset timing is adjusted by the OFC. Hence, learning is clearly divided into two steps delineated by the switch in activity of the OFC. Additionally, motor processes appear to share the working memory as well as decisional and predictive resources of the cognitive system.

Review of Orbitofrontal Cortex in Alcohol Dependence: A Disrupted Cognitive Map?

Alcoholism is a persistent worldwide problem associated with long-lasting impairments to decision making processes. Some aspects of dysfunction are thought to reflect alcohol-induced changes to relevant brain areas such as the orbitofrontal cortex (OFC). In this review, we will examine how chronic alcohol exposure alters OFC function to potentially contribute to maladaptive decision making, and explore experimental behavioral approaches that may be better suited to test whether alcohol dependence disrupts OFC's function. We argue that although past works suggest impairments in aspects of OFC function, more information may be gained by specifically targeting tasks to the broader function of OFC as put forth by the recent hypothesis of OFC as a "cognitive map" of task space. Overall, we suggest that such a focus could provide a better understanding of how OFC function changes in alcohol dependence, and could inform better assessment tools and treatment options for clinicians working with this population.

Towards a computational psychiatry of juvenile obsessive-compulsive disorder

Obsessive-Compulsive Disorder (OCD) most often emerges during adolescence, but we know little about the aberrant neural and cognitive developmental mechanisms that underlie its emergence during this critical developmental period. To move towards a computational psychiatry of juvenile OCD, we review studies on the computational, neuropsychological and neural alterations in juvenile OCD and link these findings to the adult OCD and cognitive neuroscience literature. We find consistent difficulties in tasks entailing complex decision making and set shifting, but limited evidence in other areas that are altered in adult OCD, such as habit and confidence formation. Based on these findings, we establish a neurocomputational framework that illustrates how cognition can go awry and lead to symptoms of juvenile OCD. We link these possible aberrant neural processes to neuroimaging findings in juvenile OCD and show that juvenile OCD is mainly characterised by disruptions of complex reasoning systems.

The ever-changing OFC landscape: What neural signals in OFC can tell us about inhibitory control

Despite decades of research on OFC function, the exact function(s) of OFC remain elusive. In recent years, 1 of the earliest hypotheses about OFC function, namely its involvement in inhibitory control, has drifted to the periphery of the functional OFC landscape in favor of theories suggesting a role for OFC in the representation of task or state space. The reasons for this drift are valid, owing in part to the development of more sensitive behavioral approaches, a clear emphasis on cross-species and cross-method comparisons, as well as the elegant integration of reinforcement learning theories. However, recent evidence recording from OFC during the performance of traditional inhibitory control tasks has found new evidence supporting a role for OFC in inhibitory control. While the extent to which these findings can be integrated into existing frameworks is in its infancy, this review seeks to highlight these findings with the goal of providing new insights into function of OFC. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Chemogenetic Inactivation of Orbitofrontal Cortex Decreases Cue-induced Reinstatement of Ethanol and Sucrose Seeking in Male and Female Wistar Rats

BACKGROUND

The orbitofrontal cortex (OFC) encodes internal representations of outcomes and subjective value to facilitate flexible reward seeking. OFC activation is associated with drug seeking in both human subjects and animal models. OFC plays a role in alcohol use, but studies in animal models have produced conflicting results with some showing decreased seeking after OFC inactivation but others showing increased seeking or no changes. In part, this may be due to the different measures of alcohol seeking used (e.g., homecage drinking vs. operant seeking).

METHODS

We characterized the impact of transient inactivation of OFC (primarily lateral and, to a lesser extent, ventral subregions) using inhibitory hM4Di designer receptors exclusively activated by designer drugs (DREADDs). OFC neurons were transiently inhibited during 10% and 20% alcohol (ethanol, EtOH) and sucrose homecage consumption, fixed ratio (FR1) operant self-administration, and cue-induced reinstatement of either 10% EtOH or sucrose in male and female rats.

RESULTS

OFC inactivation did not affect sucrose or EtOH consumption in the homecage, nor did it influence seeking or consumption under FR1 operant conditions. In contrast, OFC inactivation suppressed cued-induced reinstatement for both EtOH and sucrose in both male and female rats.

CONCLUSIONS

Our results are aligned with previous work indicating a selective suppressive effect of OFC inactivation on reinstatement for alcohol and other drugs of abuse. They extend these findings to demonstrate no effect on homecage consumption or FR1 seeking as well as showing an impact of sucrose reinstatement. These data indicate that OFC plays a uniquely important role when reward seeking is driven by associations between external stimuli and internal representations of reward value, both for natural and drug rewards. They further implicate the OFC as a key structure driving relapse-associated seeking and potentially contributing to alcohol use disorder and other diseases of compulsive reward seeking.

Prefrontal regulation of behavioural control: Evidence from learning theory and translational approaches in rodents

Everyday activities require adaptive decision-making and control over our actions to achieve our goals. Sub-regions within the cortex are widely reported to regulate these choices. Here we review rodent studies from two disparate fields of instrumental action control - goal-directed and habitual responding, and impulsive and compulsive behaviour. Our aim was to compare findings across the spectrum, from precision associative learning to translational studies of action control. The evidence suggests that each cortical sub-region performs different roles depending on task requirements and, within tasks, clear dissociations exist between regions. Rather than synthesizing a single role or function for a given region, we should consider regions to be capable of many different functions. Further investigation of cortico-cortical connections and the pattern of input and output circuitry within each region may be needed to identify unique process-specific pathways. Despite differences in the scope and purpose of these two fields, integrating evidence across tasks provides a broader context for testing hypotheses about the role of cortical regions in adaptive actions and decision-making.

Orbitofrontal Cortex Encodes Preference for Alcohol

Orbitofrontal cortex (OFC) plays a key role in representation and regulation of reward value, preference, and seeking. OFC function is disrupted in drug use and dependence, but its specific role in alcohol use disorders has not been thoroughly studied. In alcohol-dependent humans OFC activity is increased by alcohol cue presentation. Ethanol (EtOH) also alters OFC neuron excitability in vitro, and OFC manipulation influences EtOH seeking and drinking in rodents.

Orbitofrontal cortex (OFC) plays a key role in representation and regulation of reward value, preference, and seeking. OFC function is disrupted in drug use and dependence, but its specific role in alcohol use disorders has not been thoroughly studied. In alcohol-dependent humans OFC activity is increased by alcohol cue presentation. Ethanol (EtOH) also alters OFC neuron excitability in vitro, and OFC manipulation influences EtOH seeking and drinking in rodents. To understand the relationship between OFC function and individual alcohol use, we recorded OFC neuron activity in rats during EtOH self-administration, characterizing the neural correlates of individual preference for alcohol. After one month of intermittent access to 20% EtOH, male Long–Evans rats were trained to self-administer 20% EtOH, 10% EtOH, and 15% sucrose. OFC neuronal activity was recorded and associated with task performance and EtOH preference. Rats segregated into high and low EtOH drinkers based on homecage consumption and operant seeking of 20% EtOH. Motivation for 10% EtOH and sucrose was equally high in both groups. OFC neuronal activity was robustly increased or decreased during sucrose and EtOH seeking and consumption, and strength of changes in OFC activity was directly associated with individual preference for 20% EtOH. EtOH-associated OFC activity was more similar to sucrose-associated activity in high versus low EtOH drinkers. The results show that OFC neurons are activated during alcohol seeking based on individual preference, supporting this brain region as a potential substrate for alcohol motivation that may be dysregulated in alcohol misuse.

Brain volumes and dual-task performance correlates among individuals with cognitive impairment: a retrospective analysis

Cognitive impairment (CI) is a prevalent condition characterized by loss of brain volume and changes in cognition, motor function, and dual-tasking ability. To examine associations between brain volumes, dual-task performance, and gait and balance in those with CI to elucidate the mechanisms underlying loss of function. We performed a retrospective analysis of medical records of patients with CI and compared brain volumes, dual-task performance, and measures of gait and balance. Greater cognitive and combined dual-task effects (DTE) are associated with smaller brain volumes. In contrast, motor DTE is not associated with distinct pattern of brain volumes. As brain volumes decrease, dual-task performance becomes more motor prioritized. Cognitive DTE is more strongly associated with decreased performance on measures of gait and balance than motor DTE. Decreased gait and balance performance are also associated with increased motor task prioritization. Cognitive DTE appears to be more strongly associated with decreased automaticity and gait and balance ability than motor DTE and should be utilized as a clinical and research outcome measure in this population. The increased motor task prioritization associated with decreased brain volume and function indicates a potential for accommodative strategies to maximize function in those with CI. Counterintuitive correlations between motor brain volumes and motor DTE in our study suggest a complicated interaction between brain pathology and function.

Action-Outcome Expectancies Require Orbitofrontal Neurotrophin Systems in Naïve and Cocaine-Exposed Mice

Cocaine use during adolescence decreases the likelihood that individuals will seek treatment for recurrent drug use. In rodents, developmental cocaine exposure weakens action-consequence decision-making, causing a deferral to familiar, habit-like behavioral response strategies. Here, we aimed to improve action-outcome decision-making. We found that acute pharmacological stimulation of the tyrosine/tropomyosin receptor kinase B (trkB) via 7,8-dihydroxyflavone (7,8-DHF) or 3,4-methylenedioxymethamphetamine (MDMA) blocked cocaine-induced habit biases by strengthening memory for action-outcome associations. We believe that MDMA acts by stimulating neurotrophin/trkB systems in the orbitofrontal cortex (OFC), a region involved in prospectively evaluating the consequences of one's action, because 1) MDMA also increased brain-derived neurotrophic factor (BDNF) in the OFC, 2) MDMA corrected habit biases due to Bdnf loss in the OFC, and 3) overexpression of a truncated isoform of trkB occluded the memory-enhancing effects of MDMA. Thus, selecting actions based on their consequences requires BDNF-trkB in the OFC, the stimulation of which may improve goal attainment in both drug-naïve and cocaine-exposed individuals. SIGNIFICANCE STATEMENT: Cocaine use during adolescence decreases the likelihood that individuals will seek treatment for recurrent drug use, even as adults. Understanding how early-life cocaine exposure impacts goal-oriented action and prospective decision-making in adulthood is thus important. One key aspect of goal-directed decision-making is anticipating the consequences of one's actions, a process that likely involves the orbitofrontal cortex (OFC). In rodents, developmental cocaine exposure weakens action-consequence decision-making, causing a deferral to familiar, habit-like behavioral response strategies. Here, we report that we can improve memory for action-consequence relationships by stimulating neurotrophic factors, which support cell survival, development, and plasticity in the brain. With strengthened action-consequence associations, cocaine-exposed mice regain the ability to optimally select actions based on their likely outcomes. Brain region-selective manipulations reveal that neurotrophin systems in the OFC are necessary for stable memory of action-consequence relationships.

Real-Time Value Integration during Economic Choice Is Regulated by Orbitofrontal Cortex

Neural correlates implicate the orbitofrontal cortex (OFC) in value-based or economic decision making [1-3]. Yet inactivation of OFC in rats performing a rodent version of the standard economic choice task is without effect [4, 5], a finding more in accord with ideas that the OFC is primarily necessary for behavior when new information must be taken into account [6-9]. Neural activity in the OFC spontaneously updates to reflect new information, particularly about outcomes [10-16], and the OFC is necessary for adjustments to learned behavior only under these conditions [4, 16-26]. Here, we merge these two independent lines of research by inactivating lateral OFC during an economic choice that requires new information about the value of the predicted outcomes to be incorporated into an already established choice. Outcome value was changed by pre-feeding the rats one of two food options before testing. In control rats, this pre-feeding resulted in divergent changes in choice behavior that depended on the rats' prior preference for the pre-fed food. Optogenetic inactivation of the OFC disrupted this bi-directional effect of pre-feeding without affecting other measures that describe the underlying choice behavior. This finding unifies the role of the OFC in economic choice with its role in a host of other behaviors, causally demonstrating that the OFC is not necessary for economic choice per se-unless that choice incorporates new information about the outcomes.

mTORC1 in the orbitofrontal cortex promotes habitual alcohol seeking

The mechanistic target of rapamycin complex 1 (mTORC1) plays an important role in dendritic translation and in learning and memory. We previously showed that heavy alcohol use activates mTORC1 in the orbitofrontal cortex (OFC) of rodents (Laguesse et al., 2017a). Here, we set out to determine the consequences of alcohol-dependent mTORC1 activation in the OFC. We found that inhibition of mTORC1 activity in the OFC attenuates alcohol seeking and restores sensitivity to outcome devaluation in rats that habitually seek alcohol. In contrast, habitual responding for sucrose was unaltered by mTORC1 inhibition, suggesting that mTORC1’s role in habitual behavior is specific to alcohol. We further show that inhibition of GluN2B in the OFC attenuates alcohol-dependent mTORC1 activation, alcohol seeking and habitual responding for alcohol. Together, these data suggest that the GluN2B/mTORC1 axis in the OFC drives alcohol seeking and habit.

β1-Integrins in the Developing Orbitofrontal Cortex Are Necessary for Expectancy Updating in Mice

Navigating a changing environment requires associating stimuli and actions with their likely outcomes and modifying these associations when they change. These processes involve the orbitofrontal cortex (OFC). Although some molecular mediators have been identified, developmental factors are virtually unknown. We hypothesized that the cell adhesion factor β1-integrin is essential to OFC function, anticipating developmental windows during which β1-integrins might be more influential than others. We discovered that OFC-selective β1-integrin silencing before adolescence, but not later, impaired the ability of mice to extinguish conditioned fear and select actions based on their likely outcomes. Early-life knock-down also reduced the densities of dendritic spines, the primary sites of excitatory plasticity in the brain, and weakened sensitivity to cortical inputs. Notwithstanding these defects in male mice, females were resilient to OFC (but not hippocampal) β1-integrin loss. Existing literature suggests that resilience may be explained by estradiol-mediated transactivation of β1-integrins and tropomyosin receptor kinase B (trkB). Accordingly, we discovered that a trkB agonist administered during adolescence corrected reward-related decision making in β1-integrin-deficient males. In sum, developmental β1-integrins are indispensable for OFC function later in life.SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) is a subregion of the frontal cortex that allows organisms to link behaviors and stimuli with anticipated outcomes, and to make predictions about the consequences of one's behavior. Aspects of OFC development are particularly prolonged, extending well into adolescence, likely optimizing organisms' abilities to prospectively calculate the consequences of their actions and select behaviors appropriately; these decision making strategies improve as young individuals mature into adulthood. Molecular factors are not, however, well understood. Our experiments reveal that a cell adhesion protein termed "β1-integrin" is necessary for OFC neuronal maturation and function. Importantly, β1-integrins operate during a critical period equivalent to early adolescence in humans to optimize the ability of organisms to update expectancies later in life.

Reward-Related Expectations Trigger Dendritic Spine Plasticity in the Mouse Ventrolateral Orbitofrontal Cortex

An essential aspect of goal-directed decision-making is selecting actions based on anticipated consequences, a process that involves the orbitofrontal cortex (OFC) and potentially, the plasticity of dendritic spines in this region. To investigate this possibility, we trained male and female mice to nose poke for food reinforcers, or we delivered the same number of food reinforcers non-contingently to separate mice. We then decreased the likelihood of reinforcement for trained mice, requiring them to modify action-outcome expectations. In a separate experiment, we blocked action-outcome updating via chemogenetic inactivation of the OFC. In both cases, successfully selecting actions based on their likely consequences was associated with fewer immature, thin-shaped dendritic spines and a greater proportion of mature, mushroom-shaped spines in the ventrolateral OFC. This pattern was distinct from spine loss associated with aging, and we identified no effects on hippocampal CA1 neurons. Given that the OFC is involved in prospective calculations of likely outcomes, even when they are not observable, constraining spinogenesis while preserving mature spines may be important for solidifying durable expectations. To investigate causal relationships, we inhibited the RNA-binding protein fragile X mental retardation protein (encoded by Fmr1), which constrains dendritic spine turnover. Ventrolateral OFC-selective Fmr1 knockdown recapitulated the behavioral effects of inducible OFC inactivation (and lesions; also shown here), impairing action-outcome conditioning, and caused dendritic spine excess. Our findings suggest that a proper balance of dendritic spine plasticity within the OFC is necessary for one's ability to select actions based on anticipated consequences.SIGNIFICANCE STATEMENT Navigating a changing environment requires associating actions with their likely outcomes and updating these associations when they change. Dendritic spine plasticity is likely involved, yet relationships are unconfirmed. Using behavioral, chemogenetic, and viral-mediated gene silencing strategies and high-resolution microscopy, we find that modifying action-outcome expectations is associated with fewer immature spines and a greater proportion of mature spines in the ventrolateral orbitofrontal cortex (OFC). Given that the OFC is involved in prospectively calculating the likely outcomes of one's behavior, even when they are not observable, constraining spinogenesis while preserving mature spines may be important for maintaining durable expectations.

Mnemonic Introspection in Macaques Is Dependent on Superior Dorsolateral Prefrontal Cortex But Not Orbitofrontal Cortex

The human PFC has been associated more with meta-perceptual as opposed to meta-memory decisions from correlational neuroimaging investigations. Recently, metacognitive abilities have also been shown to be causally dependent upon anterior and dorsal PFC in nonhuman primate lesion studies. Two studies, using postdecision wagering paradigms and reversible inactivation, challenged this meta-perceptual versus meta-memory notion and showed that dorsal and anterior prefrontal areas are associated with metamemory for experienced objects and awareness of ignorance, respectively. Causal investigations are important but scarce; nothing is known, for example, about the causal contributions of prefrontal subregions to spatial metamemory. Here, we investigated the effects of dorsal versus ventral PFC lesions on two-alternative forced-choice spatial discrimination tasks in male macaque monkeys. Importantly, we were rigorous in approach and applied three independent but complementary indices used to quantify individual animals' metacognitive ability (“Type II sensitivity”) by two variants of meta-d′/d′ and phi coefficient (φ). Our results were consistent across indices: while neither lesions to superior dorsolateral PFC nor orbitofrontal cortex impaired spatial recognition performance, only monkeys with superior dorsolateral PFC lesions were impaired in meta-accuracy. Together with the observation that the same orbitofrontal cortex lesioned monkeys were impaired in updating rule value in a Wisconsin Card Sorting Test analog, we therefore document a functional double-dissociation between these two PFC regions. Our study presents important causal evidence that other dimensions, namely, domain-specific processing (e.g., spatial vs nonspatial metamemory), also need considerations in understanding the functional specialization in the neural underpinnings of introspection.

SIGNIFICANCE STATEMENT This study demonstrates macaque monkeys' metacognitive capability of introspecting its own memory success is causally dependent on intact superior dorsolateral prefrontal cortices but not the orbitofrontal cortices. Combining neurosurgical techniques on monkeys and state-of-the-art measures of metacognition, we affirm a critical role of the PFC in supporting spatial meta-recognition memory and delineate functional specificity within PFC for distinct elements of metacognition.

Distinct cortical-amygdala projections drive reward value encoding and retrieval

The value of an anticipated rewarding event is a crucial component of the decision to engage in its pursuit. But little is known of the networks responsible for encoding and retrieving this value. By using biosensors and pharmacological manipulations, we found that basolateral amygdala (BLA) glutamatergic activity tracks and mediates encoding and retrieval of the state-dependent incentive value of a palatable food reward. Projection-specific, bidirectional chemogenetic and optogenetic manipulations revealed that the orbitofrontal cortex (OFC) supports the BLA in these processes. Critically, the function of ventrolateral and medial OFC→BLA projections is doubly dissociable. Whereas lateral OFC→BLA projections are necessary and sufficient for encoding of the positive value of a reward, medial OFC→BLA projections are necessary and sufficient for retrieving this value from memory. These data reveal a new circuit for adaptive reward valuation and pursuit and provide insight into the dysfunction in these processes that characterizes myriad psychiatric diseases.

Behavioral Paradigms to Probe Individual Mouse Differences in Value-Based Decision Making

Value-based decision making relies on distributed neural systems that weigh the benefits of actions against the cost required to obtain a given outcome. Perturbations of these systems are thought to underlie abnormalities in action selection seen across many neuropsychiatric disorders. Genetic tools in mice provide a promising opportunity to explore the cellular components of these systems and their molecular foundations. However, few tasks have been designed that robustly characterize how individual mice integrate differential reward benefits and cost in their selection of actions. Here we present a forced-choice, two-alternative task in which each option is associated with a specific reward outcome, and unique operant contingency. We employed global and individual trial measures to assess the choice patterns and behavioral flexibility of mice in response to differing "choice benefits" (modeled as varying reward magnitude ratios) and different modalities of "choice cost" (modeled as either increasing repetitive motor output to obtain reward or increased delay to reward delivery). We demonstrate that (1) mouse choice is highly sensitive to the relative benefit of outcomes; (2) choice costs are heavily discounted in environments with large discrepancies in relative reward; (3) divergent cost modalities are differentially integrated into action selection; (4) individual mouse sensitivity to reward benefit is correlated with sensitivity to reward costs. These paradigms reveal stable individual animal differences in value-based action selection, thereby providing a foundation for interrogating the neural circuit and molecular pathophysiology of goal-directed dysfunction.