Organization of Afferents along the Anterior-posterior and Medial-lateral Axes of the Rat Orbitofrontal Cortex

The Role of the Orbitofrontal Cortex in the Regulation of Fear Coping Strategies

ABSTRACT

Under threats, individuals exhibit freezing behavior and prepare for active coping. The ability to flexibly shift between freezing and active coping increases survival chances in animals and decreases susceptibility to mental disorders among human beings. For example, patients with psychiatric disorders, such as obsessive-compulsive disorder and posttraumatic stress disorder, often show maladaptive coping behaviors. The orbitofrontal cortex (OFC) is a critical hub to process higher cognitive functions, sensory inputs, reward learning, and decision-making. It also regulates negative emotions and its aberrant activation level often correlates with numerous mental disorders. The rodent OFC comprises different subdivisions with varying connections to cortical and subcortical regions. Among these subdivisions, the medial orbital area (MO) and the lateral orbital area (LO) have distinct functions in the regulation of fear. Here, we updated the existing rodent literature studying the function of the OFC, with a particular focus on the MO and the LO in different coping strategies of animals. By examining the role of the OFC in the mediation of defensive coping strategies, we aim to deepen the understanding of its functional importance on mental health.

Orbitostriatal encoding of reward delayed gratification and impulsivity in chronic pain

Central robust network functional rearrangement is a characteristic of several neurological conditions, including chronic pain. Preclinical and clinical studies have shown the importance of pain-induced dysfunction in both orbitofrontal cortex (OFC) and nucleus accumbens (NAc) brain regions for the emergence of cognitive deficits. Outcome information processing recruits the orbitostriatal circuitry, a pivotal pathway regarding context-dependent reward value encoding. The current literature reveals the existence of structural and functional changes in the orbitostriatal crosstalk in chronic pain conditions, which have emerged as a possible underlying cause for reward and time discrimination impairments observed in individuals affected by such disturbances. However, more comprehensive investigations are needed to elucidate the underlying disturbances that underpin disease development. In this review article, we aim to provide a comprehensive view of the orbitostriatal mechanisms underlying time-reward dependent behaviors, and integrate previous findings on local and network malplasticity under the framework of the chronic pain sphere.

Disruption of positive- and negative-feature morphine interoceptive occasion setters by dopamine receptor agonism and antagonism in male and female rats

RATIONALE

Internally perceived stimuli evoked by morphine administration can form Pavlovian associations such that they can function as occasion setters (OSs) for externally perceived reward cues in rats, coming to modulate reward-seeking behaviour. Though much research has investigated mechanisms underlying opioid-related reinforcement and analgesia, neurotransmitter systems involved in the functioning of opioids as Pavlovian interoceptive discriminative stimuli remain to be disentangled despite documented differences in the development of tolerance to analgesic versus discriminative stimulus effects.

OBJECTIVES

Dopamine has been implicated in many opioid-related behaviours, so we aimed to investigate the role of this neurotransmitter in expression of morphine occasion setting.

METHODS

Male and female rats were assigned to positive- (FP) or negative-feature (FN) groups and received an injection of morphine or saline before each training session. A 15-s white noise conditioned stimulus (CS) was presented 8 times during every training session; offset of this stimulus was followed by 4-s access to liquid sucrose on morphine, but not saline, sessions for FP rats. FN rats learned the reverse contingency. Following stable discrimination, rats began generalization testing for expression of morphine-guided sucrose seeking after systemic pretreatment with different doses of the non-selective dopamine receptor antagonist, flupenthixol, and the non-selective dopamine receptor agonist, apomorphine, combined with training doses of morphine or saline in a Latin-square design.

RESULTS

The morphine discrimination was acquired under both FP and FN contingencies by males and females. Neither flupenthixol nor apomorphine at any dose substituted for morphine, but both apomorphine and flupenthixol disrupted expression of the morphine OS. This inhibition was specific to sucrose seeking during CS presentations rather than during the period before CS onset and, in the case of apomorphine more so than flupenthixol, to trials on which access to sucrose was anticipated.

CONCLUSIONS

Our findings lend support to a mechanism of occasion setting involving gating of CS-induced dopamine release rather than by direct dopaminergic modulation by the morphine stimulus.

Chemogenetic inactivation of the nucleus reuniens and its projections to the orbital cortex produce deficits on discrete measures of behavioral flexibility in the attentional set-shifting task

The nucleus reuniens (RE) of the ventral midline thalamus is a critical node in the communication between the orbitomedial prefrontal cortex (OFC) and the hippocampus (HF). While RE has been shown to directly participate in memory-associated functions through its connections with the medial prefrontal cortex and HF, less is known regarding the role of RE in executive functioning. Here, we examined the involvement of RE and its projections to the orbital cortex (ORB) in attention and behavioral flexibility in male rats using the attentional set shifting task (AST). Rats expressing the hM4Di DREADD receptor in RE were implanted with indwelling cannulas in either RE or the ventromedial ORB to pharmacologically inhibit RE or its projections to the ORB with intracranial infusions of clozapine-N-oxide hydrochloride (CNO). Chemogenetic-induced suppression of RE resulted in impairments in reversal learning and set-shifting. This supports a vital role for RE in behavioral flexibility - or the ability to adapt behavior to changing reward or rule contingencies. Interestingly, CNO suppression of RE projections to the ventromedial ORB produced impairments in rule abstraction - or dissociable effects elicited with direct RE suppression. In summary, the present findings indicate that RE, mediated in part by actions on the ORB, serves a critical role in the flexible use of rules to drive goal directed behavior. The cognitive deficits of various neurological disorders with impaired communication between the HF and OFC, may be partly attributed to alterations of RE -- as an established intermediary between these cortical structures.

Whole-brain Mapping of Inputs and Outputs of Specific Orbitofrontal Cortical Neurons in Mice

The orbitofrontal cortex (ORB), a region crucial for stimulus-reward association, decision-making, and flexible behaviors, extensively connects with other brain areas. However, brain-wide inputs to projection-defined ORB neurons and the distribution of inhibitory neurons postsynaptic to neurons in specific ORB subregions remain poorly characterized. Here we mapped the inputs of five types of projection-specific ORB neurons and ORB outputs to two types of inhibitory neurons. We found that different projection-defined ORB neurons received inputs from similar cortical and thalamic regions, albeit with quantitative variations, particularly in somatomotor areas and medial groups of the dorsal thalamus. By counting parvalbumin (PV) or somatostatin (SST) interneurons innervated by neurons in specific ORB subregions, we found a higher fraction of PV neurons in sensory cortices and a higher fraction of SST neurons in subcortical regions targeted by medial ORB neurons. These results provide insights into understanding and investigating the function of specific ORB neurons.

Dissociable Contributions of Basolateral Amygdala and Ventrolateral Orbitofrontal Cortex to Flexible Learning Under Uncertainty

Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including the highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, the unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory designer receptors exclusively activated by designer drugs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-/post-reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of the ventrolateral orbitofrontal cortex (vlOFC), but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.

Dissociable contributions of basolateral amygdala and ventrolateral orbitofrontal cortex to flexible learning under uncertainty

Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach and particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory DREADDs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-post reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of vlOFC, but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.

Organization of orbitofrontal-auditory pathways in the Mongolian gerbil

Sound perception is highly malleable, rapidly adjusting to the acoustic environment and behavioral demands. This flexibility is the result of ongoing changes in auditory cortical activity driven by fluctuations in attention, arousal, or prior expectations. Recent work suggests that the orbitofrontal cortex (OFC) may mediate some of these rapid changes, but the anatomical connections between the OFC and the auditory system are not well characterized. Here, we used virally mediated fluorescent tracers to map the projection from OFC to the auditory midbrain, thalamus, and cortex in a classic animal model for auditory research, the Mongolian gerbil (Meriones unguiculatus). We observed no connectivity between the OFC and the auditory midbrain, and an extremely sparse connection between the dorsolateral OFC and higher order auditory thalamic regions. In contrast, we observed a robust connection between the ventral and medial subdivisions of the OFC and the auditory cortex, with a clear bias for secondary auditory cortical regions. OFC axon terminals were found in all auditory cortical lamina but were significantly more concentrated in the infragranular layers. Tissue-clearing and lightsheet microscopy further revealed that auditory cortical-projecting OFC neurons send extensive axon collaterals throughout the brain, targeting both sensory and non-sensory regions involved in learning, decision-making, and memory. These findings provide a more detailed map of orbitofrontal-auditory connections and shed light on the possible role of the OFC in supporting auditory cognition.

Inactivation of medial or lateral orbitofrontal cortex during fear extinction did not interfere with fear renewal

Hyperactive orbitofrontal cortical activation is commonly seen in patients of obsessive-compulsive disorder (OCD). Previous studies from our laboratory showed that for rats with aberrant activation of the orbitofrontal cortex (OFC) during the extinction phase, they were unable to use contexts as the reference for proper retrieval of fear memory during renewal test. This result supported the phenomenon that many OCD patients show poor regulation of fear-related behavior. Since there are robust anatomical connections of the OFC with the fear-circuit, we aim to further examine whether the OFC is actively engaged in fear regulation under normal circumstances. In this study, the lateral or medial OFC was inactivated during the extinction phase using the ABA fear renewal procedure. We found that these animals showed intact fear renewal during retrieval test with their freezing levels equivalent to the control rats, revealing that the OFC did not have decisive roles in extinction acquisition. Together with our previous study, we suggest that the OFC only interferes with fear regulation when it becomes pathophysiologically hyperactive.

The efferent connections of the orbitofrontal, posterior parietal, and insular cortex of the rat brain

The orbitofrontal, posterior parietal, and insular cortices are sites of higher-order cognitive processing implicated in a wide range of behaviours, including working memory, attention guiding, decision making, and spatial navigation. To better understand how these regions contribute to such functions, we need detailed knowledge about the underlying structural connectivity. Several tract-tracing studies have investigated specific aspects of orbitofrontal, posterior parietal and insular connectivity, but a digital resource for studying the cortical and subcortical projections from these areas in detail is not available. We here present a comprehensive collection of brightfield and fluorescence microscopic images of serial coronal sections from 49 rat brain tract-tracing experiments, in which discrete injections of the anterograde tracers biotinylated dextran amine and/or Phaseolus vulgaris leucoagglutinin were placed in the orbitofrontal, parietal, or insular cortex. The images are spatially registered to the Waxholm Space Rat brain atlas. The image collection, with corresponding reference atlas maps, is suitable as a reference framework for investigating the brain-wide efferent connectivity of these cortical association areas.

GluN2B inhibition confers resilience against long-term cocaine-induced neurocognitive sequelae

Cocaine self-administration can disrupt the capacity of humans and rodents to flexibly modify familiar behavioral routines, even when they become maladaptive or unbeneficial. However, mechanistic factors, particularly those driving long-term behavioral changes, are still being determined. Here, we capitalized on individual differences in oral cocaine self-administration patterns in adolescent mice and revealed that the post-synaptic protein PSD-95 was reduced in the orbitofrontal cortex (OFC) of escalating, but not stable, responders, which corresponded with later deficits in flexible decision-making behavior. Meanwhile, NMDA receptor GluN2B subunit content was lower in the OFC of mice that were resilient to escalatory oral cocaine seeking. This discovery led us to next co-administer the GluN2B-selective antagonist ifenprodil with cocaine, blocking the later emergence of cocaine-induced decision-making abnormalities. GluN2B inhibition also prevented cocaine-induced dysregulation of neuronal structure and function in the OFC, preserving mature, mushroom-shaped dendritic spine densities on deep-layer pyramidal neurons, which were otherwise lower with cocaine, and safeguarding functional BLA→OFC connections necessary for action flexibility. We posit that cocaine potentiates GluN2B-dependent signaling, which triggers a series of durable adaptations that result in the dysregulation of post-synaptic neuronal structure in the OFC and disruption of BLA→OFC connections, ultimately weakening the capacity for flexible choice. And thus, inhibiting GluN2B-NMDARs promotes resilience to long-term cocaine-related sequelae.

A Novel Insular/Orbital-Prelimbic Circuit That Prevents Persistent Avoidance in a Rodent Model of Compulsive Behavior

BACKGROUND

A common symptom of obsessive-compulsive disorder is the persistent avoidance of cues incorrectly associated with negative outcomes. This maladaptation becomes increasingly evident as subjects fail to respond to extinction-based treatments such as exposure-with-response prevention therapy. While previous studies have highlighted the role of the insular-orbital cortex in fine-tuning avoidance-based decisions, little is known about the projections from this area that might modulate compulsive-like avoidance.

METHODS

Here, we used anatomical tract-tracing, single-unit recording, and optogenetics to characterize the projections from the insular-orbital cortex. To model exposure-with-response prevention and persistent avoidance in rats, we used the platform-mediated avoidance task followed by extinction-with-response prevention training.

RESULTS

Using tract-tracing and unit recording, we found that projections from the agranular insular/lateral orbital (AI/LO) cortex to the prefrontal cortex predominantly target the rostral portion of the prelimbic (rPL) cortex and excite rPL neurons. Photoinhibiting this projection induced persistent avoidance after extinction-with-response prevention training, an effect that was still present 1 week later. Consistent with this, photoexcitation of this projection prevented persistent avoidance in overtrained rats. This projection to rPL appears to be key for AI/LO's effects, considering that there was no effect of photoinhibiting AI/LO projections to the ventral striatum or basolateral amygdala.

CONCLUSIONS

Our findings suggest that projections from the AI/LO to the rPL decreases the likelihood of avoidance behavior following extinction. In humans, this connectivity may share some homology of projections from lateral prefrontal cortices (i.e., ventrolateral prefrontal cortex, orbitofrontal cortex, and insula) to other prefrontal areas and the anterior cingulate cortex, suggesting that reduced activity in these pathways may contribute to obsessive-compulsive disorder.

Theta oscillations in anterior cingulate cortex and orbitofrontal cortex differentially modulate accuracy and speed in flexible reward learning

Flexible reward learning relies on frontal cortex, with substantial evidence indicating that anterior cingulate cortex (ACC) and orbitofrontal cortex (OFC) subregions play important roles. Recent studies in both rat and macaque suggest theta oscillations (5-10 Hz) may be a spectral signature that coordinates this learning. However, network-level interactions between ACC and OFC in flexible learning remain unclear. We investigated the learning of stimulus-reward associations using a combination of simultaneous in vivo electrophysiology in dorsal ACC and ventral OFC, partnered with bilateral inhibitory DREADDs in ACC. In freely behaving male and female rats and using a within-subject design, we examined accuracy and speed of response across distinct and precisely defined trial epochs during initial visual discrimination learning and subsequent reversal of stimulus-reward contingencies. Following ACC inhibition, there was a propensity for random responding in early reversal learning, with correct vs. incorrect trials distinguished only from OFC, not ACC, theta power differences in the reversal phase. ACC inhibition also hastened incorrect choices during reversal. This same pattern of change in accuracy and speed was not observed in viral control animals. Thus, characteristics of impaired reversal learning following ACC inhibition are poor deliberation and weak theta signaling of accuracy in this region. The present results also point to OFC theta oscillations as a prominent feature of reversal learning, unperturbed by ACC inhibition.

Projections from the five divisions of the orbital cortex to the thalamus in the rat

The orbital cortex (ORB) of the rat consists of five divisions: the medial (MO), ventral (VO), ventrolateral (VLO), lateral (LO), and dorsolateral (DLO) orbital cortices. No previous report has comprehensively examined and compared projections from each division of the ORB to the thalamus. Using the anterograde anatomical tracer, Phaseolus vulgaris leucoagglutinin, we describe the efferent projections from the five divisions of the ORB to the thalamus in the rat. We demonstrated that, with some overlap, each division of the ORB distributed in a distinct (and unique) manner to nuclei of the thalamus. Overall, ORB projected to a relatively restricted number of sites in the thalamus, and strikingly distributed entirely to structures of the medial/midline thalamus, while completely avoiding lateral regions or principal nuclei of the thalamus. The main termination sites in the thalamus were the paratenial nucleus (PT) and nucleus reuniens (RE) of the midline thalamus, the medial (MDm) and central (MDc) divisions of the mediodorsal nucleus, the intermediodorsal nucleus, the central lateral, paracentral, and central medial nuclei of the rostral intralaminar complex and the submedial nucleus (SM). With some exceptions, medial divisions of the ORB (MO, VO) mainly targeted "limbic-associated" nuclei such as PT, RE, and MDm, whereas lateral division (VLO, LO, DLO) primarily distributed to "sensorimotor-associated" nuclei including MDc, SM, and the rostral intralaminar complex. As discussed herein, the medial/midline thalamus may represent an important link (or bridge) between the orbital cortex and the hippocampus and between the ORB and medial prefrontal cortex. In summary, the present results demonstrate that each division of the orbital cortex projects in a distinct manner to nuclei of the thalamus which suggests unique functions for each division of the orbital cortex.

Orbitofrontal cortex populations are differentially recruited to support actions

The ability to use information from one's prior actions is necessary for decision-making. While orbitofrontal cortex (OFC) has been hypothesized as key for inferences made using cue and value-related information, whether OFC populations contribute to the use of information from volitional actions to guide behavior is not clear. Here, we used a self-paced lever-press hold-down task in which mice infer prior lever-press durations to guide subsequent action performance. We show that the activity of genetically identified lateral OFC (lOFC) subpopulations differentially instantiate current and prior action information during ongoing action execution. Transient state-dependent lOFC circuit disruptions of specified subpopulations reduced the encoding of ongoing press durations but did not disrupt the use of prior action information to guide future action performance. In contrast, a chronic functional loss of lOFC circuit activity resulted in increased reliance on recently executed lever-press durations and impaired contingency reversal, suggesting the recruitment of compensatory mechanisms that resulted in repetitive action control. Our results identify a novel role for lOFC in the integration of action information to guide adaptive behavior.

Role of Orbitofrontal Cortex and Differential Effects of Acute and Chronic Stress on Motor Impulsivity Measured With 1-Choice Serial Reaction Time Test in Male Rats

BACKGROUND

Deficits in motor impulsivity, that is, the inability to inhibit a prepotent response, are frequently observed in psychiatric conditions. Several studies suggest that stress often correlates with higher impulsivity. Among the brain areas affected by stress, the orbitofrontal cortex (OFC) is notable because of its role in impulse control. OFC subregions with unique afferent and efferent circuitry play distinct roles in impulse control, yet it is not clear what OFC subregions are engaged during motor impulsivity tasks.

METHODS

In this study we used a rodent test of motor impulsivity, the 1-choice serial reaction time test, to explore activation of OFC subregions either during a well-learned motor impulsivity task or in a challenge task with a longer wait time that increases premature responding. We also examined the effects of acute inescapable stress, chronic intermittent cold stress and chronic unpredictable stress on motor impulsivity.

RESULTS

Fos expression increased in the lateral OFC and agranular insular cortex during performance in both the mastered and challenge conditions. In the ventral OFC, Fos expression increased only during challenge, and within the medial OFC, Fos was not induced in either condition. Inescapable stress produced a transient effect on premature responses in the mastered task, whereas chronic intermittent cold stress and chronic unpredictable stress altered premature responses in both conditions in ways specific to each stressor.

CONCLUSIONS

These results suggest that different OFC subregions have different roles in motor impulse control, and the effects of stress vary depending on the nature and duration of the stressor.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

A molecularly integrated amygdalo-fronto-striatal network coordinates flexible learning and memory

Behavioral flexibility-that is, the ability to deviate from established behavioral sequences-is critical for navigating dynamic environments and requires the durable encoding and retrieval of new memories to guide future choice. The orbitofrontal cortex (OFC) supports outcome-guided behaviors. However, the coordinated neural circuitry and cellular mechanisms by which OFC connections sustain flexible learning and memory remain elusive. Here we demonstrate in mice that basolateral amygdala (BLA)→OFC projections bidirectionally control memory formation when familiar behaviors are unexpectedly not rewarded, whereas OFC→dorsomedial striatum (DMS) projections facilitate memory retrieval. OFC neuronal ensembles store a memory trace for newly learned information, which appears to be facilitated by circuit-specific dendritic spine plasticity and neurotrophin signaling within defined BLA-OFC-DMS connections and obstructed by cocaine. Thus, we describe the directional transmission of information within an integrated amygdalo-fronto-striatal circuit across time, whereby novel memories are encoded by BLA→OFC inputs, represented within OFC ensembles and retrieved via OFC→DMS outputs during future choice.

Aberrant orbitofrontal cortical activation interferes with encoding of Pavlovian fear conditioning

Obsessive-compulsive disorder (OCD) patients were usually found with the hyper-activation of the orbitofrontal cortex (OFC) and a deficit in fear extinction learning. The OFC can be subdivided into the lateral OFC (lOFC) and the medial OFC (mOFC). Previous studies have suggested that both subregions are involved in the modulation of negative emotions. However, how aberrant activation of the OFC interacts with the encoding of Pavlovian fear remains unknown. In this study, the lOFC or the mOFC was pharmacologically activated or inactivated before the fear conditioning on Day 1, followed by a context test on Day 2 and a tone test on Day 3 in male Long-Evans rats. We found that for the animals that underwent fear conditioning under aberrant activation of either the lOFC or the mOFC, they showed normal within-session fear expression. However, the acquisition/consolidation of contextual fear was impaired under mOFC activation, while the acquisition/consolidation of cued fear was impaired under either the lOFC or the mOFC activation, in that these animals showed lower freezing compared to controls during the retrieval test. On the other hand, for the animals that underwent fear conditioning under inactivation of either the lOFC or the mOFC, they showed normal within-session fear expression, as well as intact encoding of both the contextual and cued fear. Together, our results suggested that the OFC was not actively engaged in the acquisition of Pavlovian fear conditioning, but aberrant activation of the OFC impaired fear learning.

Analysis of collateral projections from the lateral orbitofrontal cortex to nucleus accumbens and basolateral amygdala in rats

The orbitofrontal cortex (OFC) is an important brain area for executive functions. The OFC projects to both the nucleus accumbens (NAc) and the basolateral nucleus of the amygdala (BLA). These two pathways share some similar behavioral functions, but their anatomical and physiological properties have not been compared before. In this study, we first explored the connection of the lateral OFC (lOFC) to NAc core (NAcc) and/or BLA, especially the collateral projections (Experiment 1 and 2) with rats. In Experiment 1, fluorophore-conjugated retrograde tracers were locally infused into the NAcc and the BLA to sample neurons in the lOFC. Our results revealed that along the anterior-posterior axis of the lOFC, more NAcc- and/or BLA-projecting neurons were distributed toward the posterior end, but the average percentage of collateral projecting neurons at the four sampled lOFC levels remained fairly stable. In Experiment 2, antidromic single units in the lOFC responsive to the NAcc and/or the BLA stimulation were identified in anesthetized rats. However, we found that collateral projections from the lOFC to NAcc and BLA were sparse. We next studied the physiological characteristics of these two pathways (Experiment 3). In this experiment, orthodromic single units in the NAcc or the BLA responsive to the lOFC stimulation were located in anesthetized rats. Our results showed no difference in the evoked thresholds or the intensity-response probability curves between the two. Together, our results showed that these two pathways were similar in projecting neuron distribution and physiological characteristics.

Reinforcement learning detuned in addiction: integrative and translational approaches

Suboptimal decision-making strategies have been proposed to contribute to the pathophysiology of addiction. Decision-making, however, arises from a collection of computational components that can independently influence behavior. Disruptions in these different components can lead to decision-making deficits that appear similar behaviorally, but differ at the computational, and likely the neurobiological, level. Here, we discuss recent studies that have used computational approaches to investigate the decision-making processes underlying addiction. Studies in animal models have found that value updating following positive, but not negative, outcomes is predictive of drug use, whereas value updating following negative, but not positive, outcomes is disrupted following drug self-administration. We contextualize these findings with studies on the circuit and biological mechanisms of decision-making to develop a framework for revealing the biobehavioral mechanisms of addiction.

Foraging with the frontal cortex: A cross-species evaluation of reward-guided behavior

Efficient foraging is essential to survival and depends on frontal cortex in mammals. Because of its role in psychiatric disorders, frontal cortex and its contributions to reward procurement have been studied extensively in both rodents and non-human primates. How frontal cortex of these animal models compares is a source of intense debate. Here we argue that translating findings from rodents to non-human primates requires an appreciation of both the niche in which each animal forages as well as the similarities in frontal cortex anatomy and function. Consequently, we highlight similarities and differences in behavior and anatomy, before focusing on points of convergence in how parts of frontal cortex contribute to distinct aspects of foraging in rats and macaques, more specifically. In doing so, our aim is to emphasize where translation of frontal cortex function between species is clearer, where there is divergence, and where future work should focus. We finish by highlighting aspects of foraging for which have received less attention but we believe are critical to uncovering how frontal cortex promotes survival in each species.

Relative salience signaling within a thalamo-orbitofrontal circuit governs learning rate

Learning to predict rewards is essential for the sustained fitness of animals. Contemporary views suggest that such learning is driven by a reward prediction error (RPE)-the difference between received and predicted rewards. The magnitude of learning induced by an RPE is proportional to the product of the RPE and a learning rate. Here we demonstrate using two-photon calcium imaging and optogenetics in mice that certain functionally distinct subpopulations of ventral/medial orbitofrontal cortex (vmOFC) neurons signal learning rate control. Consistent with learning rate control, trial-by-trial fluctuations in vmOFC activity positively correlate with behavioral updating when the RPE is positive, and negatively correlates with behavioral updating when the RPE is negative. Learning rate is affected by many variables including the salience of a reward. We found that the average reward response of these neurons signals the relative salience of a reward, because it decreases after reward prediction learning or the introduction of another highly salient aversive stimulus. The relative salience signaling in vmOFC is sculpted by medial thalamic inputs. These results support emerging theoretical views that prefrontal cortex encodes and controls learning parameters.

Beyond the hippocampus: The role of parahippocampal-prefrontal communication in context-modulated behavior

Multiple paradigms indicate that the physical environment can influence spontaneous and learned behavior. In rodents, context-dependent behavior is putatively supported by the prefrontal cortex and the medial temporal lobe. A preponderance of the literature has targeted the role of the hippocampus. In addition to the hippocampus proper, the medial temporal lobe also comprises parahippocampal areas, including the perirhinal and postrhinal cortices. These parahippocampal areas directly connect with multiple regions in the prefrontal cortex. The function of these connections, however, is not well understood. This article first reviews the involvement of the perirhinal, postrhinal, and prefrontal cortices in context-dependent behavior in rodents. Then, based on functional and anatomical evidence, we suggest that perirhinal and postrhinal contributions to context-dependent behavior go beyond supporting context representation in the hippocampus. Specifically, we propose that the perirhinal and postrhinal cortices act as a contextual-support network that directly provides contextual and spatial information to the prefrontal cortex. In turn, the perirhinal and postrhinal cortices modulate prefrontal input to the hippocampus in the service of context-guided behavior.

Coherent theta activity in the medial and orbital frontal cortices encodes reward value

This study examined how the medial frontal (MFC) and orbital frontal (OFC) cortices process reward information. We simultaneously recorded local field potentials in the two areas as rats consumed liquid sucrose rewards. Both areas exhibited a 4-8 Hz 'theta' rhythm that was phase-locked to the lick cycle. The rhythm tracked shifts in sucrose concentrations and fluid volumes, demonstrating that it is sensitive to differences in reward magnitude. The coupling between the rhythm and licking was stronger in MFC than OFC and varied with response vigor and absolute reward value in the MFC. Spectral analysis revealed zero-lag coherence between the cortical areas, and found evidence for a directionality of the rhythm, with MFC leading OFC. Our findings suggest that consummatory behavior generates simultaneous theta range activity in the MFC and OFC that encodes the value of consumed fluids, with the MFC having a top-down role in the control of consumption.

A common limiter circuit for opioid choice and relapse identified in a rodent addiction model

Activity in numerous brain regions drives heroin seeking, but no circuits that limit heroin seeking have been identified. Furthermore, the neural circuits controlling opioid choice are unknown. In this study, we examined the role of the infralimbic cortex (IL) to nucleus accumbens shell (NAshell) pathway during heroin choice and relapse. This model yielded subpopulations of heroin versus food preferring rats during choice, and choice was unrelated to subsequent relapse rates to heroin versus food cues, suggesting that choice and relapse are distinct behavioral constructs. Supporting this, inactivation of the IL with muscimol produced differential effects on opioid choice versus relapse. A pathway-specific chemogenetic approach revealed, however, that the IL-NAshell pathway acts as a common limiter of opioid choice and relapse. Furthermore, dendritic spines in IL-NAshell neurons encode distinct aspects of heroin versus food reinforcement. Thus, opioid choice and relapse share a common addiction-limiting circuit in the IL-NAshell pathway.

Ethanol modulation of cortico-basolateral amygdala circuits: Neurophysiology and behavior

This review highlights literature relating the anatomy, physiology, and behavioral contributions by projections between rodent prefrontal cortical areas and the basolateral amygdala. These projections are robustly modulated by both environmental experience and exposure to drugs of abuse including ethanol. Recent literature relating optogenetic and chemogenetic dissection of these circuits within behavior both compliments and occasionally challenges roles defined by more traditional pharmacological or lesion-based approaches. In particular, cortico-amygdala circuits help control both aversive and reward-seeking. Exposure to pathology-producing environments or abused drugs dysregulates the relative 'balance' of these outcomes. Modern circuit-based approaches have also shown that overlapping populations of neurons within a given brain region frequently govern both aversion and reward-seeking. In addition, these circuits often dramatically influence 'local' cortical or basolateral amygdala excitatory or inhibitory circuits. Our understanding of these neurobiological processes, particularly in relation to ethanol research, has just begun and represents a significant opportunity.

A bidirectional corticoamygdala circuit for the encoding and retrieval of detailed reward memories

Adaptive reward-related decision making often requires accurate and detailed representation of potential available rewards. Environmental reward-predictive stimuli can facilitate these representations, allowing one to infer which specific rewards might be available and choose accordingly. This process relies on encoded relationships between the cues and the sensory-specific details of the rewards they predict. Here, we interrogated the function of the basolateral amygdala (BLA) and its interaction with the lateral orbitofrontal cortex (lOFC) in the ability to learn such stimulus-outcome associations and use these memories to guide decision making. Using optical recording and inhibition approaches, Pavlovian cue-reward conditioning, and the outcome-selective Pavlovian-to-instrumental transfer (PIT) test in male rats, we found that the BLA is robustly activated at the time of stimulus-outcome learning and that this activity is necessary for sensory-specific stimulus-outcome memories to be encoded, so they can subsequently influence reward choices. Direct input from the lOFC was found to support the BLA in this function. Based on prior work, activity in BLA projections back to the lOFC was known to support the use of stimulus-outcome memories to influence decision making. By multiplexing optogenetic and chemogenetic inhibition we performed a serial circuit disconnection and found that the lOFC→BLA and BLA→lOFC pathways form a functional circuit regulating the encoding (lOFC→BLA) and subsequent use (BLA→lOFC) of the stimulus-dependent, sensory-specific reward memories that are critical for adaptive, appetitive decision making.

The Role of the Rodent Lateral Orbitofrontal Cortex in Simple Pavlovian Cue-Outcome Learning Depends on Training Experience

The orbitofrontal cortex (OFC) is a critical structure in the flexible control of value-based behaviors. OFC dysfunction is typically only detected when task or environmental contingencies change, against a backdrop of apparently intact initial acquisition and behavior. While intact acquisition following OFC lesions in simple Pavlovian cue-outcome conditioning is often predicted by models of OFC function, this predicted null effect has not been thoroughly investigated. Here, we test the effects of lesions and temporary muscimol inactivation of the rodent lateral OFC on the acquisition of a simple single cue-outcome relationship. Surprisingly, pretraining lesions significantly enhanced acquisition after overtraining, whereas post-training lesions and inactivation significantly impaired acquisition. This impaired acquisition to the cue reflects a disruption of behavioral control and not learning since the cue could also act as an effective blocking stimulus in an associative blocking procedure. These findings suggest that even simple cue-outcome representations acquired in the absence of OFC function are impoverished. Therefore, while OFC function is often associated with flexible behavioral control in complex environments, it is also involved in very simple Pavlovian acquisition where complex cue-outcome relationships are irrelevant to task performance.