Prefrontal neurons encode context-based response execution and inhibition in reward seeking and extinction

The secondary visual cortex mediated the enhancement of associative learning on methamphetamine self-administration behaviors

RATIONALE

Methamphetamine addiction is a persistent and intractable pathological learning and memory, whereas no approved therapeutics is available. However, few attentions have been paid to how associative learning participates in the formation of intractable memory related to drug addiction OBJECTIVES AND METHODS: To investigate the role of associative learning in methamphetamine addiction and the underlying neurobiological mechanism, methamphetamine self-administration, oral sucrose self-administration, chemogenetic neuromanipulation, and fiber photometry in mice were performed in this study.

RESULTS

We reported that associative learning increased methamphetamine-induced self-administration, but not oral sucrose self-administration. In addition, the enhancement of methamphetamine-induced self-administration was independent of more methamphetamine consumption, and remained with higher drug-taking and motivation in the absence of visual cues, suggesting the direct effects of the associative learning that enhanced methamphetamine-induced self-administration. Moreover, chemogenetic inactivation of the secondary visual cortex (V2) reduced the enhancement of the drug-taking induced by associative learning but did not alter sucrose-taking. Further fiber photometry of V2 neurons demonstrated that methamphetamine-associative learning elicits V2 neuron excitation, and sucrose-associative learning elicits V2 neuron inhibition.

CONCLUSIONS

Therefore, this study reveals the neurobiological mechanism of V2 excitability underlying how associative learning participates in the formation of intractable memory related to drug addiction, and gives evidence to support V2 as a promising target for stimulation therapy for methamphetamine addiction.

VTA Excitatory Neurons Control Reward-driven Behavior by Modulating Infralimbic Cortical Firing

The functional dichotomy of anatomical regions of the medial prefrontal cortex (mPFC) has been tested with greater certainty in punishment-driven tasks, and less so in reward-oriented paradigms. In the infralimbic cortex (IL), known for behavioral suppression (STOP), tasks linked with reward or punishment are encoded through firing rate decrease or increase, respectively. Although the ventral tegmental area (VTA) is the brain region governing reward/aversion learning, the link between its excitatory neuron population and IL encoding of reward-linked behavioral expression is unclear. Here, we present evidence that IL ensembles use a population-based mechanism involving broad inhibition of principal cells at intervals when reward is presented or expected. The IL encoding mechanism was consistent across multiple sessions with randomized rewarded target sites. Most IL neurons exhibit FR (Firing Rate) suppression during reward acquisition intervals (T1), and subsequent exploration of previously rewarded targets when the reward is omitted (T2). Furthermore, FR suppression in putative IL ensembles persisted for intervals that followed reward-linked target events. Pairing VTA glutamate inhibition with reward acquisition events reduced the weight of reward-target association expressed as a lower affinity for previously rewarded targets. For these intervals, fewer IL neurons per mouse trial showed FR decrease and were accompanied by an increase in the percentage of units with no change in FR. Together, we conclude that VTA glutamate neurons are likely involved in establishing IL inhibition states that encode reward acquisition, and subsequent reward-target association.

Distributed and specific encoding of sensory, motor, and decision information in the mouse neocortex during goal-directed behavior

Goal-directed behaviors involve coordinated activity in many cortical areas, but whether the encoding of task variables is distributed across areas or is more specifically represented in distinct areas remains unclear. Here, we compared representations of sensory, motor, and decision information in the whisker primary somatosensory cortex, medial prefrontal cortex, and tongue-jaw primary motor cortex in mice trained to lick in response to a whisker stimulus with mice that were not taught this association. Irrespective of learning, properties of the sensory stimulus were best encoded in the sensory cortex, whereas fine movement kinematics were best represented in the motor cortex. However, movement initiation and the decision to lick in response to the whisker stimulus were represented in all three areas, with decision neurons in the medial prefrontal cortex being more selective, showing minimal sensory responses in miss trials and motor responses during spontaneous licks. Our results reconcile previous studies indicating highly specific vs. highly distributed sensorimotor processing.

Non-consummatory behavior signals predict aversion-resistant alcohol drinking in head-fixed mice

A key facet of alcohol use disorder is continuing to drink alcohol despite negative consequences (so called "aversion-resistant drinking"). In this study, we sought to assess the degree to which head-fixed mice exhibit aversion-resistant drinking and to leverage behavioral analysis techniques available in head-fixture to relate non-consummatory behaviors to aversion-resistant drinking. We assessed aversion-resistant drinking in head-fixed female and male C57BL/6 J mice. We adulterated 20% (v/v) alcohol with varying concentrations of the bitter tastant quinine to measure the degree to which mice would continue to drink despite this aversive stimulus. We recorded high-resolution video of the mice during head-fixed drinking, tracked body parts with machine vision tools, and analyzed body movements in relation to consumption. Female and male head-fixed mice exhibited heterogenous levels of aversion-resistant drinking. Additionally, non-consummatory behaviors, such as paw movement and snout movement, were related to the intensity of aversion-resistant drinking. These studies demonstrate that head-fixed mice exhibit aversion-resistant drinking and that non-consummatory behaviors can be used to assess perceived aversiveness in this paradigm. Furthermore, these studies lay the groundwork for future experiments that will utilize advanced electrophysiological techniques to record from large populations of neurons during aversion-resistant drinking to understand the neurocomputational processes that drive this clinically relevant behavior. This article is part of the Special Issue on "PFC circuit function in psychiatric disease and relevant models".

Prelimbic cortex inactivation prevents ABA renewal based on stress state

Our recent research suggests that the interoceptive state associated with stress can function as a contextual stimulus for operant behavior. In the present experiment, we investigated the role of the rodent prelimbic cortex (PL), a brain region that is critical in contextual control of operant behavior, in the ability of a stressed state to produce ABA renewal of an extinguished operant response. Rats were trained to perform a lever press response for a food pellet reward during daily sessions that followed exposure to a stressor that changed each day. The response was then extinguished in the absence of stress. ABA renewal of extinguished responding occurred following exposure to another stressor (different from any used during acquisition) in control rats but not in rats that received a PL-inactivating infusion (baclofen/muscimol). Results confirm that the interoceptive state of stress can play the role of a contextual stimulus and initiate renewal (relapse) of an inhibited behavior when stress has previously been associated with the behavior. In conjunction with our previous work, the present results support the hypothesis that the PL is important for contexts, both exteroceptive and interoceptive, to exert such control over operant behavior. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Divergent reward cue representations in the prefrontal cortex drive reward motivation in adolescence and adulthood

Alterations in motivation and reward-seeking are a transdiagnostic feature of numerous psychiatric disorders that commonly emerge in adolescence, including depression, obsessive- compulsive disorder, and attention deficit hyperactivity disorder. During adolescence, reward motivation is naturally heightened, compared to adulthood, but the underlying mechanisms are not well understood. The medial prefrontal cortex (mPFC) is a late developing brain region that regulates reward learning and motivation and is still maturing in adolescence. The mPFC modulates reward-motivated behaviors in adults, and has been hypothesized to be responsible for adolescents' inability to suppress reward-seeking and impulsive behaviors. Using 2-photon imaging of the mPFC and an active reward task, we demonstrate that both the adult and adolescent mPFC encode reward-predictive cues, with distinct neuronal populations encoding rewarded and unrewarded cues. In adolescence the mPFC is hyper-responsive to reward cues and recruits a larger population of neurons to encode reward predictive cues. Furthermore, in the adolescent mPFC, representations of unrewarded cues are attenuated, compared to the adult mPFC, which may tip the balance of action toward reward-seeking. Differences in neuronal responses to rewarded and unrewarded cues were observed in both GABAergic and glutamatergic neurons, with GABAergic inhibition causing disparate effects in adolescents compared to adults. Together our findings identify differences in the functional properties of mPFC microcircuits in adolescents that may underlie differences in reward-seeking behavior and the ability to adaptively suppress reward seeking.

Non-Consummatory Behavior Signals Predict Aversion-Resistant Alcohol Drinking in Head-Fixed Mice

A key facet of alcohol use disorder is continuing to drink alcohol despite negative consequences (so called "aversion-resistant drinking"). In this study, we sought to assess the degree to which head-fixed mice exhibit aversion-resistant drinking and to leverage behavioral analysis techniques available in head-fixture to relate non-consummatory behaviors to aversion-resistant drinking. We assessed aversion-resistant drinking in head-fixed female and male C57BL/6J mice. We adulterated 20% (v/v) alcohol with varying concentrations of the bitter tastant quinine to measure the degree to which mice would continue to drink despite this aversive stimulus. We recorded high-resolution video of the mice during head-fixed drinking, tracked body parts with machine vision tools, and analyzed body movements in relation to consumption. Female and male head-fixed mice exhibited heterogenous levels of aversion-resistant drinking. Additionally, non-consummatory behaviors, such as paw movement and snout movement, were related to the intensity of aversion-resistant drinking. These studies demonstrate that head-fixed mice exhibit aversion-resistant drinking and that non-consummatory behaviors can be used to assess perceived aversiveness in this paradigm. Furthermore, these studies lay the groundwork for future experiments that will utilize advanced electrophysiological techniques to record from large populations of neurons during aversion-resistant drinking to understand the neurocomputational processes that drive this clinically relevant behavior.

Maternal neglect alters reward-anticipatory behavior, social status stability, and reward circuit activation in adult male rats

Introduction

Adverse early life experiences affect neuronal growth and maturation of reward circuits that modify behavior under reward predicting conditions. Previous studies demonstrate that rats undergoing denial of expected reward in the form of maternal contact (DER-animal model of maternal neglect) during early post-natal life developed anhedonia, aggressive play-fight behaviors and aberrant prefrontal cortex structure and neurochemistry. Although many studies revealed social deficiency following early-life stress most reports focus on individual animal tasks. Thus, attention needs to be given on the social effects during group tasks in animals afflicted by early life adversity.

Methods

To investigate the potential impact of the DER experience on the manifestation of behavioral responses induced by natural rewards, we evaluated: 1) naïve adult male sexual preference and performance, and 2) anticipatory behavior during a group 2-phase food anticipation learning task composed of a context-dependent and a cue-dependent learning period.

Results

DER rats efficiently spent time in the vicinity of and initiated sexual intercourse with receptive females suggesting an intact sexual reward motivation and consummation. Interestingly, during the context-dependent phase of food anticipation training DER rats displayed a modified exploratory activity and lower overall reward-context association. Moreover, during the cue-dependent phase DER rats displayed a mild deficit in context-reward association while increased cue-dependent locomotion. Additionally, DER rats displayed unstable food access priority following food presentation. These abnormal behaviours were accompanied by overactivation of the ventral prefrontal cortex and nucleus accumbens, as assessed by pCREB levels.

Conclusions/discussion

Collectively, these data show that the neonatal DER experience resulted in adulthood in altered activation of the reward circuitry, interfered with the normal formation of context-reward associations, and disrupted normal reward access hierarchy formation. These findings provide additional evidence to the deleterious effects of early life adversity on reward system, social hierarchy formation, and brain function.

Circadian desynchronization disrupts physiological rhythms of prefrontal cortex pyramidal neurons in mice

Disruption of circadian rhythms, such as shift work and jet lag, are associated with negative physiological and behavioral outcomes, including changes in affective state, learning and memory, and cognitive function. The prefrontal cortex (PFC) is heavily involved in all of these processes. Many PFC-associated behaviors are time-of-day dependent, and disruption of daily rhythms negatively impacts these behavioral outputs. Yet how disruption of daily rhythms impacts the fundamental function of PFC neurons, and the mechanism(s) by which this occurs, remains unknown. Using a mouse model, we demonstrate that the activity and action potential dynamics of prelimbic PFC neurons are regulated by time-of-day in a sex specific manner. Further, we show that postsynaptic K⁺ channels play a central role in physiological rhythms, suggesting an intrinsic gating mechanism mediating physiological activity. Finally, we demonstrate that environmental circadian desynchronization alters the intrinsic functioning of these neurons independent of time-of-day. These key discoveries demonstrate that daily rhythms contribute to the mechanisms underlying the essential physiology of PFC circuits and provide potential mechanisms by which circadian disruption may impact the fundamental properties of neurons.

Selective ablation of VIP interneurons in the rodent prefrontal cortex results in increased impulsivity

It has been well-established that novelty-seeking and impulsivity are significant risk factors for the development of psychological disorders, including substance use disorder and behavioral addictions. While dysfunction in the prefrontal cortex is at the crux of these disorders, little is known at the cellular level about how alterations in neuron activity can drive changes in impulsivity and novelty seeking. We harnessed a cre-dependent caspase-3 ablation in both male and female mice to selectively ablate vasoactive intestinal peptide (VIP)-expressing interneurons in the prefrontal cortex to better explore how this microcircuit functions during specific behavioral tasks. Caspase-ablated animals had no changes in anxiety-like behaviors or hedonic food intake but had a specific increase in impulsive responding during longer trials in the three-choice serial reaction time test. Together, these data suggest a circuit-level mechanism in which VIP interneurons function as a gate to selectively respond during periods of high expectation.

Blockade of orexin receptors in the infralimbic cortex prevents stress-induced reinstatement of alcohol-seeking behaviour in alcohol-dependent rats

BACKGROUND AND PURPOSE

A major problem managing alcohol use disorder is the high vulnerability to relapse, even after long periods of abstinence. Chronic alcohol use dysregulates stress responsivity, rendering this system hyporesponsive and making individuals vulnerable to relapse. Orexin (hypocretin) plays a role in diverse physiological processes, including stress. Orexin neurons in the hypothalamus, project to the infralimbic cortex. This study asked does infralimbic cortex orexin transmission play a significant role in stress-induced reinstatement of alcohol-seeking behaviour in alcohol-dependent rats.

EXPERIMENTAL APPROACH

Male and female rats were trained to self-administer 10% alcohol (3 weeks) and then made dependent via chronic intermittent alcohol vapour exposure. Following extinction (5 days·week-1 at 8 h abstinence for 10 sessions), rats received an intra- infralimbic cortex microinfusion of the OX1/2 antagonist TCS 1102 (15 μg/0.5 μl per side) and then tested for footshock stress-induced reinstatement of alcohol seeking. In a separate cohort, orexin regulation of infralimbic cortex neuronal activity at the time of reinstatement was investigated using ex vivo electrophysiology.

KEY RESULTS

TCS 1102 prevented reinstatement in dependent animals only. Moreover, Hcrtr mRNA expression in the hypothalamus and Hcrtr1/2 in the infralimbic cortex increased in alcohol-dependent animals at the time of testing. Dependence dampened basal orexin/OX receptor influence over infralimbic cortex GABAergic synapses (using TCS 1102) allow for greater stimulated orexin effects.

CONCLUSION AND IMPLICATIONS

Infralimbic cortex transmission is implicate in stress-induced reinstatement of alcohol-seeking behaviour in subjects with a history of alcohol dependence and show maladaptive recruitment of infralimbic cortex transmission by alcohol dependence.

Altered neuronal activity in the ventromedial prefrontal cortex drives nicotine intake escalation

Nicotine addiction develops after prolonged drug use and escalation of drug intake. However, because of difficulties in demonstrating escalation of nicotine use in rats, its underlying neuroadaptations still remain poorly understood. Here we report that access to unusually high doses of nicotine (i.e., from 30 µg to 240 µg/kg/injection) for self-administration precipitated a rapid and robust escalation of nicotine intake and increased the motivation for the drug in rats. This nicotine intake escalation also induced long-lasting changes in vmPFC neuronal activity both before and during nicotine self-administration. Specifically, after escalation of nicotine intake, basal vmPFC neuronal activity increased above pre-escalation and control activity levels, while ongoing nicotine self-administration restored these neuronal changes. Finally, simulation of the restoring effects of nicotine with in vivo optogenetic inhibition of vmPFC neurons caused a selective de-escalation of nicotine self-administration.

Prelimbic and infralimbic medial prefrontal cortex neuron activity signals cocaine seeking variables across multiple timescales

RATIONALE AND OBJECTIVES

The prefrontal cortex is critical for execution and inhibition of reward seeking. Neural manipulation of rodent medial prefrontal cortex (mPFC) subregions differentially impacts execution and inhibition of cocaine seeking. Dorsal, or prelimbic (PL), and ventral, or infralimbic (IL) mPFC are implicated in cocaine seeking or extinction of cocaine seeking, respectively. This differentiation is not seen across all studies, indicating that further research is needed to understand specific mPFC contributions to drug seeking.

METHODS

We recorded neuronal activity in mPFC subregions during cocaine self-administration, extinction, and cue- and cocaine-induced reinstatement of cocaine seeking.

RESULTS

Both PL and IL neurons were phasically responsive around lever presses during cocaine self-administration, and activity in both areas was reduced during extinction. During both cue- and, to a greater extent, cocaine-induced reinstatement, PL neurons exhibited significantly elevated responses, in line with previous studies demonstrating a role for the region in relapse. The enhanced PL signaling in cocaine-induced reinstatement was driven by strong excitation and inhibition in different groups of neurons. Both of these response types were stronger in PL vs. IL neurons. Finally, we observed tonic changes in activity in all tasks phases, reflecting both session-long contextual modulation as well as minute-to-minute activity changes that were highly correlated with brain cocaine levels and motivation associated with cocaine seeking.

CONCLUSIONS

Although some differences were observed between PL and IL neuron activity across sessions, we found no evidence of a go/stop dichotomy in PL/IL function. Instead, our results demonstrate temporally heterogeneous prefrontal signaling during cocaine seeking and extinction in both PL and IL, revealing novel and complex functions for both regions during these behaviors. This combination of findings argues that mPFC neurons, in both PL and IL, provide multifaceted contributions to the regulation of drug seeking and addiction.

Neural correlates of recall and extinction in a rat model of appetitive Pavlovian conditioning

Extinction is a fundamental form of inhibitory learning that is important for adapting to changing environmental contingencies. While numerous studies have investigated the neural correlates of extinction using Pavlovian fear conditioning and appetitive operant reward-seeking procedures, less is known about the neural circuitry mediating the extinction of appetitive Pavlovian responding. Here, we aimed to generate an extensive brain activation map of extinction learning in a rat model of appetitive Pavlovian conditioning. Male Long-Evans rats were trained to associate a conditioned stimulus (CS; 20 s white noise) with the delivery of a 10% sucrose unconditioned stimulus (US; 0.3 ml/CS) to a fluid port. Control groups also received CS presentations, but sucrose was delivered either during the inter-trial interval or in the home-cage. After conditioning, 1 or 6 extinction sessions were conducted in which the CS was presented but sucrose was withheld. We performed Fos immunohistochemistry and network connectivity analyses on a set of cortical, striatal, thalamic, and amygdalar brain regions. Neural activity in the prelimbic cortex, ventral orbitofrontal cortex, nucleus accumbens core, and paraventricular nucleus of the thalamus was greater during recall relative to extinction. Conversely, prolonged extinction following 6 sessions induced increased neural activity in the infralimbic cortex, medial orbitofrontal cortex, and nucleus accumbens shell compared to home-cage controls. All these structures were similarly recruited during recall on the first extinction session. These findings provide novel evidence for the contribution of brain areas and neural networks that are differentially involved in the recall versus extinction of appetitive Pavlovian conditioned responding.

Multidimensional Pain Modulation by Acupuncture Analgesia: The Reward Effect of Acupuncture on Pain Relief

Pain is an intrinsically unpleasant experience with features that protect an organism by promoting motivation and learning. Pain relief, a negative reinforcement of pain, is considered a reward and activates the brain's reward system. The reward circuit in the brain involves reward and pain. Acupuncture has a multidimensional and comprehensive regulating effect on chronic pain. However, the reward effect of acupuncture in relieving chronic pain and the mechanism of the brain reward circuit involved in acupuncture analgesia are not thoroughly studied. In this article, we have reviewed the definition of pain abnormalities and negative emotions in patients with chronic pain, the conceptual characteristics of analgesic reward, and the new progress in studying brain reward circuits and functions. Moreover, we have expounded on the critical clinical and scientific significance of studying the reward effect of acupuncture analgesia and related brain reward circuits, the pain mechanism obtained from human neuroimaging studies, and the survey results on the effects of acupuncture on reward/motivation circuits. Some viewpoints and suggestions on the reward effect of acupuncture analgesia and related reward circuits have been put forward to clarify the multidimensional characteristics and benign regulation of acupuncture analgesia. Studies on the reward effect of acupuncture in relieving chronic pain and the regulating effect of the brain reward loop on acupuncture analgesia help to deepen the clinical understanding of acupuncture analgesia, innovate the research concept of acupuncture analgesia, and provide help for further studies on the central mechanism of acupuncture in improving chronic pain in the future.

Prelimbic cortex neural encoding dynamically tracks expected outcome value

Animals must modify their behavior based on updated expected outcomes in a changing environment. Prelimbic cortex (PrL) neural encoding during learning predicts, and is necessary for, appropriately altering behavior based on a new expected outcome value following devaluation. We aimed to determine how PrL neural activity encodes reward predictive cues after the expected outcome value of those cues is decreased following conditioned taste aversion. In one post-devaluation session, rats were tested under extinction to determine their ability to alter their behavior to the expected outcome values (i.e., extinction test). In a second post-devaluation session, rats were tested with the newly devalued outcome delivered so that the rats experienced the updated outcome value within the session (i.e., re-exposure test). We found that PrL neural encoding of the cue associated with the devalued reward predicted the ability of rats to suppress behavior in the extinction test session, but not in the re-exposure test session. While all rats were able to successfully devalue the outcome during conditioned taste aversion, a subset of rats continued to consume the devalued outcome in the re-exposure test session. We found differential patterns of PrL neural encoding in the population of rats that did not avoid the devalued outcome during the re-exposure test compared to the rats that successfully avoided the devalued outcome. Our findings suggest that PrL neural encoding dynamically tracks expected outcome values, and differential neural encoding in the PrL to reward predictive cues following expected outcome value changes may contribute to distinct behavioral phenotypes.

Visuomotor learning promotes visually evoked activity in the medial prefrontal cortex

The medial prefrontal cortex (mPFC) is necessary for executing many learned associations between stimuli and movement. It is unclear, however, how activity in the mPFC evolves across learning, and how this activity correlates with sensory stimuli and the learned movements they evoke. To address these questions, we record cortical activity with widefield calcium imaging while mice learned to associate a visual stimulus with a forelimb movement. After learning, the mPFC shows stimulus-evoked activity both during task performance and during passive viewing, when the stimulus evokes no action. This stimulus-evoked activity closely tracks behavioral performance across training, with both exhibiting a marked increase between days when mice first learn the task, followed by a steady increase with further training. Electrophysiological recordings localized this activity to the secondary motor and anterior cingulate cortex. We conclude that learning a visuomotor task promotes a route for visual information to reach the prefrontal cortex.

From ensembles to meta-ensembles: Specific reward encoding by correlated network activity

Neuronal ensembles are local, sparsely distributed populations of neurons that are reliably re-activated by a specific stimulus, context or task. Such discrete cell populations can be defined either functionally, by electrophysiological recordings or in vivo calcium imaging, or anatomically, using the expression of markers such as the immediate early gene cFos. A typical example of tasks that involve the formation of neuronal ensembles is reward learning, such as the cue-reward pairing during operant conditioning. These ensembles are re-activated during cue-presentation and increasing evidence suggests that this re-activation is the neurophysiological basis for the execution of reward-seeking behavior. Whilst the pursuit of rewards is a common daily activity, it is also related to the consumption of drugs, such as alcohol, and may result in problematic behaviors including addiction. Recent research has identified neuronal ensembles in several reward-related brain regions that control distinct aspects of a conditioned response, e.g., contextual information about the availability of a specific reward or the actions needed to retrieve this reward under the given circumstances. Here, we review studies using the activity marker cFos to identify and characterize neuronal ensembles related to alcohol and non-drug rewards with a special emphasis on the discrimination between different rewards by meta-ensembles, i.e., by dynamic co-activation of multiple ensembles across different brain areas.

Compulsive alcohol drinking in rodents is associated with altered representations of behavioral control and seeking in dorsal medial prefrontal cortex

A key feature of compulsive alcohol drinking is continuing to drink despite negative consequences. To examine the changes in neural activity that underlie this behavior, compulsive alcohol drinking was assessed in a validated rodent model of heritable risk for excessive drinking (alcohol preferring (P) rats). Neural activity was measured in dorsal medial prefrontal cortex (dmPFC-a brain region involved in maladaptive decision-making) and assessed via change point analyses and novel principal component analyses. Neural population representations of specific decision-making variables were measured to determine how they were altered in animals that drink alcohol compulsively. Compulsive animals showed weakened representations of behavioral control signals, but strengthened representations of alcohol seeking-related signals. Finally, chemogenetic-based excitation of dmPFC prevented escalation of compulsive alcohol drinking. Collectively, these data indicate that compulsive alcohol drinking in rats is associated with alterations in dmPFC neural activity that underlie diminished behavioral control and enhanced seeking.

Extinction of Cocaine Memory Depends on a Feed-Forward Inhibition Circuit Within the Medial Prefrontal Cortex

BACKGROUND

Cocaine-associated environments (i.e., contexts) evoke persistent memories of cocaine reward and thereby contribute to the maintenance of addictive behavior in cocaine users. From a therapeutic perspective, enhancing inhibitory control over cocaine-conditioned responses is of pivotal importance but requires a more detailed understanding of the neural circuitry that can suppress context-evoked cocaine memories, e.g., through extinction learning. The ventral medial prefrontal cortex (vmPFC) and dorsal medial prefrontal cortex (dmPFC) are thought to bidirectionally regulate responding to cocaine cues through their projections to other brain regions. However, whether these mPFC subregions interact to enable adaptive responding to cocaine-associated contextual stimuli has remained elusive.

METHODS

We used antero- and retrograde tracing combined with chemogenetic intervention to examine the role of vmPFC-to-dmPFC projections in extinction of cocaine-induced place preference in mice. In addition, electrophysiological recordings and optogenetics were used to determine whether parvalbumin-expressing inhibitory interneurons and pyramidal neurons in the dmPFC are innervated by vmPFC projections.

RESULTS

We found that vmPFC-to-dmPFC projecting neurons are activated during unreinforced re-exposure to a cocaine-associated context, and selective suppression of these cells impairs extinction learning. Parvalbumin-expressing inhibitory interneurons in the dmPFC receive stronger monosynaptic excitatory input from vmPFC projections than local dmPFC pyramidal neurons, consequently resulting in disynaptic inhibition of pyramidal neurons. In line with this, we show that chemogenetic suppression of dmPFC parvalbumin-expressing inhibitory interneurons impairs extinction learning.

CONCLUSIONS

Our data reveal that vmPFC projections mediate extinction of a cocaine-associated contextual memory through recruitment of feed-forward inhibition in the dmPFC, thereby providing a novel neuronal substrate that promotes extinction-induced inhibitory control.

Corticotropin-releasing factor receptor 1 in infralimbic cortex modulates social stress-altered decision-making

Chronic stress could lead to a bias in behavioral strategies toward habits. However, it remains unclear which neuronal system modulates stress-induced behavioral abnormality during decision making. The corticotropin-releasing factor (CRF) system in the medial prefrontal cortex (mPFC), which has been implicated in governing strategy choice, is involved in the response to stress. The present study aimed to clarify whether altered function in cortical CRF receptors is linked to abnormal behaviors after chronic stress. In results, mice subjected to a 10-day social defeat preferred to use a habitual strategy. The infralimbic cortex (IL), but not the prelimbic cortex (PL) or anterior cingulate cortex (ACC), showed higher cFos expression in stress-subjected mice than in control mice, which may be associated with habitual behavior choice. Furthermore, CRF receptor 1 (CRFR1) agonist and antagonist infusion in IL during behavioral training mimicked and rescued stress-caused behavioral change in the decision-making assessment, respectively. An electrophysiological approach showed that the frequencies of both spontaneous IPSC and spontaneous EPSC, but not their amplitude, increased after stress and were modulated by CRFR1 agents. Further recordings revealed that an increased ratio of excitation to inhibition (E/I ratio) of IL by stress was rescued under conditions with CRFR1 antagonist. Collectively, these data indicate that CRFR1 plays a critical role in stress-permitted or enhanced glutamatergic and GABAergic presynaptic transmission in direct or indirect ways, as well as the modulation for E/I ratio in the IL. Thus, CRFR1 in the mPFC may be a proper target for treating cases of chronic stress-altered behavior.

Prelimbic medial prefrontal cortex has bidirectional control over the expression of behavioral sensitization to 3,4-methylenedioxymethamphetamine (MDMA; ecstasy) depending on the context of drug administration

Behavioral sensitization to MDMA is observed in the vast majority of rats if tested in the same environment in which previous MDMA exposure occurred, but not if tested in a novel, unpaired context. Previous studies have revealed a critical role for the prelimbic region of medial prefrontal cortex (PL) in the expression of sensitization to MDMA, but these studies assessed sensitization only in MDMA-paired environments. Given that PL activity can both facilitate and suppress behavior depending on context, we tested the hypothesis that PL has bidirectional control over the expression of locomotor sensitization to MDMA depending on the context of drug administration. Rats were treated with either saline or MDMA (5.0 mg/kg) twice daily for 5 days, in either their home cages (unpaired groups) or the activity monitors that were used for tests of sensitization on challenge days (paired groups). Prior to MDMA challenge injections (2.5 mg/kg; at ∼2 weeks of withdrawal), rats received bilateral PL microinjections of either lidocaine (100 μg/0.5 μl/side) or physiological saline (0.5 μl/side). Locomotor activity in response to MDMA challenge was unaffected by PL inactivation in saline pretreated rats. However, PL inactivation caused a decrease in locomotion to the challenge injection in MDMA/paired rats and an increase in locomotion in MDMA/unpaired rats. These results establish a novel role for PL in suppressing the expression of behavioral sensitization when subjects are challenged in a drug-unpaired context, adding to the literature implicating PL activity in both the expression and inhibition of other drug-related behaviors.

Blockade of corticotropin-releasing factor-1 receptors in the infralimbic cortex prevents stress-induced reinstatement of alcohol seeking in male Wistar rats: Evidence of interaction between CRF1 and orexin receptor signaling

Alcohol use dysregulates responsivity to stress, which is mediated by corticotropin-releasing factor (CRF). With repeated cycles of alcohol use, the hypothalamic-pituitary-adrenal axis becomes hyporesponsive, rendering individuals vulnerable to the reinstatement of alcohol-seeking behavior during stressful episodes. Orexin (Orx; also called hypocretin) plays a well-established role in regulating diverse physiological processes, including stress, and interacts with CRF. The infralimbic cortex (IL) is a CRF-rich region. Anatomical evidence suggests that CRF and Orx interact in this area. To test the behavioral implication of CRF and Orx transmission in the IL during the stress-induced reinstatement of alcohol-seeking behavior, male Wistar rats were trained to self-administer 10% alcohol for 3 weeks. The rats then underwent two weeks of extinction training (identical to the alcohol self-administration sessions, but alcohol was withheld). The day after the last extinction session, the rats received a bilateral intra-IL injection of the CRF1 receptor antagonist CP154,526 (0.6 μg/0.5 μl/side), the dual Orx receptor antagonist TCS1102 (15 μg/0.5 μl/side), or their combination and then were tested for the footshock stress-induced reinstatement of alcohol-seeking behavior. CP154,526 significantly prevented reinstatement, but TCS1102 did not produce such an effect. Interestingly, the co-administration of TCS1102 and CP154,526 reversed the effect of CP154,526 alone, and footshock stress induced a significant increase in Crhr1 and Hcrtr2 mRNA expression in the IL. These results demonstrate a functional interaction between Orx receptor and CRF1 receptor signaling and suggest that CRF1 receptor antagonism may ameliorate stress-induced alcohol-seeking behavior.

Cortico-Striatal Control over Adaptive Goal-Directed Responding Elicited by Cues Signaling Sucrose Reward or Punishment

The medial prefrontal cortex (mPFC) and nucleus accumbens (NAc) have been associated with the expression of adaptive and maladaptive behavior elicited by fear-related and drug-associated cues. However, reported effects of mPFC manipulations on cue-elicited natural reward-seeking and inhibition thereof have been varied, with few studies examining cortico-striatal contributions in tasks that require adaptive responding to cues signaling reward and punishment within the same session. The current study aimed to better elucidate the role of mPFC and NAc subdivisions, and their functional connectivity in cue-elicited adaptive responding using a novel discriminative cue responding task. Male Long-Evans rats learned to lever-press on a VR5 schedule for a discriminative cue signaling reward, and to avoid pressing the same lever in the presence of another cue signaling punishment. Postacquisition, prelimbic (PL) and infralimbic (IL) areas of the mPFC, NAc core, shell, PL-core, or IL-shell circuits were pharmacologically or chemogenetically inhibited while animals performed under (1) nonreinforced (extinction) conditions, where the appetitive and aversive cues were presented in alternating trials alone or as a compound stimulus; and (2) reinforced conditions, whereby cued responding was accompanied by associated outcomes. PL and IL inactivation attenuated nonreinforced and reinforced goal-directed cue responding, whereas NAc core and shell inactivation impaired nonreinforced responding for the appetitive, but not aversive cue. Furthermore, PL-core and IL-shell inhibition disinhibited nonreinforced but not reinforced cue responding. Our findings implicate the mPFC as a site of confluence of motivationally significant cues and outcomes, and in the regulation of nonreinforced cue responding via downstream NAc targets.SIGNIFICANCE STATEMENT The ability to discriminate and respond appropriately to environmental cues that signal availability of reward or punishment is essential for survival. The medial prefrontal cortex (mPFC) and nucleus accumbens (NAc) have been implicated in adaptive and maladaptive behavior elicited by fear-related and drug-associated cues. However, less is known about the role they play in orchestrating adaptive responses to natural reward and punishment cues within the same behavioral task. Here, using a novel discriminative cue responding task combined with pharmacological or chemogenetic inhibition of mPFC, NAc and mPFC-NAc circuits, we report that mPFC is critically involved in responding to changing cued response-outcomes, both when the responses are reinforced, and nonreinforced. Furthermore, the mPFC coordinates nonreinforced discriminative cue responding by suppressing inappropriate responding via downstream NAc targets.

The rodent medial prefrontal cortex and associated circuits in orchestrating adaptive behavior under variable demands

Emerging evidence implicates rodent medial prefrontal cortex (mPFC) in tasks requiring adaptation of behavior to changing information from external and internal sources. However, the computations within mPFC and subsequent outputs that determine behavior are incompletely understood. We review the involvement of mPFC subregions, and their projections to the striatum and amygdala in two broad types of tasks in rodents: 1) appetitive and aversive Pavlovian and operant conditioning tasks that engage mPFC-striatum and mPFC-amygdala circuits, and 2) foraging-based tasks that require decision making to optimize reward. We find support for region-specific function of the mPFC, with dorsal mPFC and its projections to the dorsomedial striatum supporting action control with higher cognitive demands, and ventral mPFC engagement in translating affective signals into behavior via discrete projections to the ventral striatum and amygdala. However, we also propose that defined mPFC subdivisions operate as a functional continuum rather than segregated functional units, with crosstalk that allows distinct subregion-specific inputs (e.g., internal, affective) to influence adaptive behavior supported by other subregions.

Comparison of prefrontal cortex sucrose seeking ensembles engaged in multiple seeking sessions: Context is key

Encoding of memories, including those associated with prior drug or reward, is thought to take place within distinct populations of neurons, termed ensembles. Neuronal ensembles for drug- and reward-seeking have been identified in regions of the medial prefrontal cortex, but much of our understanding of these ensembles is based on experiments that take place in a single reward-associated environment and measure ensemble encoding over short durations of time. In contrast, reward seeking behavior is evident across different reward-associated environments and persists over time. Using TetTag mice and Fos immunohistochemistry, we examined the relationship between persistent sucrose-seeking and ensemble encoding in mice that undergo seeking sessions in the same or different sucrose self-administration contexts 2 weeks apart. We found that prelimbic (PrL) and anterior cingulate cortex ensembles tagged in the first seeking session were highly sensitive to the context in which a second seeking session took place: reactivation of these ensembles was reduced in the same context but elevated in a distinct sucrose self-administration context. Correlational analyses revealed that ensemble reactivation in the PrL was proportional to the persistence of sucrose seeking behavior across sessions in differing ways in female mice. In the same context, reactivation was proportional to the persistence of non-reinforced operant responses, whereas in a distinct context, reactivation was proportional to the persistence of non-reinforced head entries into the sucrose receptacle. This study underlines the importance of the medial prefrontal cortex importance in maintaining a reward-seeking ensemble over time and identifies context-dependent changes in behavioral correlates of ensemble reactivation.

Neural reinstatement reveals divided organization of fear and extinction memories in the human brain

Neurobiological research in rodents has revealed that competing experiences of fear and extinction are stored as distinct memory traces in the brain. This divided organization is adaptive for mitigating overgeneralization of fear to related stimuli that are learned to be safe while also maintaining threat associations for unsafe stimuli. The mechanisms involved in organizing these competing memories in the human brain remain unclear. Here, we used a hybrid form of Pavlovian conditioning with an episodic memory component to identify overlapping multivariate patterns of fMRI activity associated with the formation and retrieval of fear versus extinction. In healthy adults, distinct regions of the medial prefrontal cortex (PFC) and hippocampus showed selective reactivation of fear versus extinction memories based on the temporal context in which these memories were encoded. This dissociation was absent in participants with posttraumatic stress disorder (PTSD) symptoms. The divided neural organization of fear and extinction may support flexible retrieval of context-appropriate emotional memories, while their disorganization may promote overgeneralization and increased fear relapse in affective disorders.

Prefrontal-hippocampal interactions supporting the extinction of emotional memories: the retrieval stopping model

Neuroimaging has revealed robust interactions between the prefrontal cortex and the hippocampus when people stop memory retrieval. Efforts to stop retrieval can arise when people encounter reminders to unpleasant thoughts they prefer not to think about. Retrieval stopping suppresses hippocampal and amygdala activity, especially when cues elicit aversive memory intrusions, via a broad inhibitory control capacity enabling prepotent response suppression. Repeated retrieval stopping reduces intrusions of unpleasant memories and diminishes their affective tone, outcomes resembling those achieved by the extinction of conditioned emotional responses. Despite this resemblance, the role of inhibitory fronto-hippocampal interactions and retrieval stopping broadly in extinction has received little attention. Here we integrate human and animal research on extinction and retrieval stopping. We argue that reconceptualising extinction to integrate mnemonic inhibitory control with learning would yield a greater understanding of extinction's relevance to mental health. We hypothesize that fear extinction spontaneously engages retrieval stopping across species, and that controlled suppression of hippocampal and amygdala activity by the prefrontal cortex reduces fearful thoughts. Moreover, we argue that retrieval stopping recruits extinction circuitry to achieve affect regulation, linking extinction to how humans cope with intrusive thoughts. We discuss novel hypotheses derived from this theoretical synthesis.

Neural correlates and determinants of approach-avoidance conflict in the prelimbic prefrontal cortex

The recollection of environmental cues associated with threat or reward allows animals to select the most appropriate behavioral responses. Neurons in the prelimbic (PL) cortex respond to both threat- and reward-associated cues. However, it remains unknown whether PL regulates threat-avoidance vs. reward-approaching responses when an animals’ decision depends on previously associated memories. Using a conflict model in which male Long–Evans rats retrieve memories of shock- and food-paired cues, we observed two distinct phenotypes during conflict: (1) rats that continued to press a lever for food (Pressers) and (2) rats that exhibited a complete suppression in food seeking (Non-pressers). Single-unit recordings revealed that increased risk-taking behavior in Pressers is associated with persistent food-cue responses in PL, and reduced spontaneous activity in PL glutamatergic (PL^GLUT) neurons during conflict. Activating PL^GLUT neurons in Pressers attenuated food-seeking responses in a neutral context, whereas inhibiting PL^GLUT neurons in Non-pressers reduced defensive responses and increased food approaching during conflict. Our results establish a causal role for PL^GLUT neurons in mediating individual variability in memory-based risky decision-making by regulating threat-avoidance vs. reward-approach behaviors.

Infralimbic cortex functioning across motivated behaviors: Can the differences be reconciled?

The rodent infralimbic cortex (IL) is implicated in higher order executive functions such as reward seeking and flexible decision making. However, the precise nature of its role in these processes is unclear. Early evidence indicated that the IL promotes the extinction and ongoing inhibition of fear conditioning and cocaine seeking. However, evidence spanning other behavioral domains, such as natural reward seeking and habit-based learning, suggests a more nuanced understanding of IL function. As techniques have advanced and more studies have examined IL function, identifying a unifying explanation for its behavioral function has become increasingly difficult. Here, we discuss evidence of IL function across motivated behaviors, including associative learning, drug seeking, natural reward seeking, and goal-directed versus habit-based behaviors, and emphasize how context-specific encoding and heterogeneous IL neuronal populations may underlie seemingly conflicting findings in the literature. Together, the evidence suggests that a major IL function is to facilitate the encoding and updating of contingencies between cues and behaviors to guide subsequent behaviors.

Aversive stimuli bias corticothalamic responses to motivationally significant cues

Making predictions about future rewards or punishments is fundamental to adaptive behavior. These processes are influenced by prior experience. For example, prior exposure to aversive stimuli or stressors changes behavioral responses to negative- and positive-value predictive cues. Here, we demonstrate a role for medial prefrontal cortex (mPFC) neurons projecting to the paraventricular nucleus of the thalamus (PVT; mPFC→PVT) in this process. We found that a history of aversive stimuli negatively biased behavioral responses to motivationally relevant cues in mice and that this negative bias was associated with hyperactivity in mPFC→PVT neurons during exposure to those cues. Furthermore, artificially mimicking this hyperactive response with selective optogenetic excitation of the same pathway recapitulated the negative behavioral bias induced by aversive stimuli, whereas optogenetic inactivation of mPFC→PVT neurons prevented the development of the negative bias. Together, our results highlight how information flow within the mPFC→PVT circuit is critical for making predictions about motivationally-relevant outcomes as a function of prior experience.

Replicability in measures of attentional set-shifting task performance predicting chronic heavy drinking in rhesus monkeys

This study was designed to replicate and extend a previous report that the increase in performance of an attentional set-shifting task (ASST) in rhesus monkeys predicted their future alcohol drinking status as a heavy drinker (HD) or non-heavy drinker (NHD). A cohort of 6 young adult male monkeys was trained and tested under the same ASST and then underwent a alcohol self-administration protocol that maintained open-access (22 hours/day) choice of alcohol or water 7 days/week for approximately 6 months. The average improvement in performance in the ASST, as measured by a performance index, was replicated in the cohort of 6 monkeys when compared to the increase in the task performance in a previous cohort of 9 male monkeys. The alcohol self-administration protocol was then used to determine the drinking status (HD: n = 4 or NHD: n = 2) of the replicate cohort, which was accurately predicted by the performance on the ASST. Finally, individuals from both cohorts could be combined based on future drinking status of HD (n = 8) or NHD (n = 7), and the association with pre-alcohol ASST performance remained. Specifically, monkeys that had lower rates of PI improvement were more likely to become HDs. To our knowledge, this is the first study to replicate that deficits in the set-shifting performance can predict chronic heavy alcohol drinking in primates.

Acute neuroinflammation increases excitability of prefrontal parvalbumin interneurons and their functional recruitment during novel object recognition

There is an emerging body of literature suggesting that unlike the chronic neuroinflammatory response, acute neuroinflammation is self-regulated and is beneficial for central nervous system homeostasis and cognitive integrity. However, the neurophysiological alterations upon acute neuroinflammation and their implications on cognitive function remain poorly understood. In the present study, we reliably established a mouse model of acute and self-limiting neuroinflammation by administering a single intraperitoneal injection of low-dose lipopolysaccharide, which induced reversible sickness behavior and increased pro-inflammatory cytokine expression in the medial prefrontal cortex (mPFC). During acute neuroinflammation, fast-spiking parvalbumin-expressing interneurons (PV interneurons) in the mPFC exhibited a hyperexcitable phenotype exemplified by increased input resistance, decreased rheobase current, and a higher frequency of action potentials. Furthermore, PV interneurons in the prelimbic subregion of the mPFC were excessively recruited into circuits supporting novel object recognition memory, which remained intact after acute neuroinflammation. Together, our findings suggest that alterations in PV neuronal excitability resulting from acute neuroinflammation may mediate neuronal recruitment and confer a beneficial outcome on functional integrity of NOR circuit in the mPFC.

Inactivation of the infralimbic cortex decreases discriminative stimulus-controlled relapse to cocaine seeking in rats

Persistent susceptibility to cue-induced relapse is a cardinal feature of addiction. Discriminative stimuli (DSs) are one type of drug-associated cue that signal drug availability (DS+) or unavailability (DS-) and control drug seeking prior to relapse. We previously established a trial-based procedure in rats to isolate DSs from context, conditioned stimuli, and other drug-associated cues during cocaine self-administration and demonstrated DS-controlled cocaine seeking up to 300 abstinence days. The behavioral and neural mechanisms underlying trial-based DS-control of drug seeking have rarely been investigated. Here we show that following discrimination training in our trial-based procedure, the DS+ and DS- independently control the expression and suppression of cocaine seeking during abstinence. Using microinjections of GABA_A + GABA_B receptor agonists (muscimol + baclofen) in medial prefrontal cortex, we report that infralimbic, but not prelimbic, subregion of medial prefrontal cortex is critical to persistent DS-controlled relapse to cocaine seeking after prolonged abstinence, but not DS-guided discriminated cocaine seeking or DS-controlled cocaine self-admininstration. Finally, using ex vivo whole-cell recordings from pyramidal neurons in the medial prefrontal cortex, we demonstrate that the disruption of DS-controlled cocaine seeking following infralimbic cortex microinjections of muscimol+baclofen is likely a result of suppression of synaptic transmission in the region via a presynaptic mechanism of action.

Effects of Biological Sex and Stress Exposure on Ventromedial Prefrontal Regulation of Mood-Related Behaviors

The ventral portion of the medial prefrontal cortex (vmPFC) regulates mood, sociability, and context-dependent behaviors. Consequently, altered vmPFC activity has been implicated in the biological basis of emotional disorders. Recent methodological advances have greatly enhanced the ability to investigate how specific prefrontal cell populations regulate mood-related behaviors, as well as the impact of long-term stress on vmPFC function. However, emerging preclinical data identify prominent sexual divergence in vmPFC behavioral regulation and stress responsivity. Notably, the rodent infralimbic cortex (IL), a vmPFC subregion critical for anti-depressant action, shows marked functional divergence between males and females. Accordingly, this review examines IL encoding and modulation of mood-related behaviors, including coping style, reward, and sociability, with a focus on sex-based outcomes. We also review how these processes are impacted by prolonged stress exposure. Collectively, the data suggest that chronic stress has sex-specific effects on IL excitatory/inhibitory balance that may account for sex differences in the prevalence and course of mood disorders.

Specialized coding patterns among dorsomedial prefrontal neuronal ensembles predict conditioned reward seeking

Non-overlapping cell populations within dorsomedial prefrontal cortex (dmPFC), defined by gene expression or projection target, control dissociable aspects of reward seeking through unique activity patterns. However, even within these defined cell populations, considerable cell-to-cell variability is found, suggesting that greater resolution is needed to understand information processing in dmPFC. Here, we use two-photon calcium imaging in awake, behaving mice to monitor the activity of dmPFC excitatory neurons throughout Pavlovian reward conditioning. We characterize five unique neuronal ensembles that each encodes specialized information related to a sucrose reward, reward-predictive cues, and behavioral responses to those cues. The ensembles differentially emerge across daily training sessions – and stabilize after learning – in a manner that improves the predictive validity of dmPFC activity dynamics for deciphering variables related to behavioral conditioning. Our results characterize the complex dmPFC neuronal ensemble dynamics that stably predict reward availability and initiation of conditioned reward seeking following cue-reward learning.

Food-Seeking Behavior Is Mediated by Fos-Expressing Neuronal Ensembles Formed at First Learning in Rats

Neuronal ensembles in the infralimbic cortex (IL) develop after prolonged food self-administration training. However, rats demonstrate evidence of learning the food self-administration response as early as day 1, with responding quickly increasing to asymptotic levels. Since the contribution of individual brain regions to task performance shifts over the course of training, it remains unclear whether IL ensembles are gradually formed and refined over the course of extensive operant training, or whether functionally-relevant ensembles might be recruited and formed as early as the initial acquisition of food self-administration behavior. Here, we aimed to determine the role of IL ensembles at the earliest possible point after demonstrable learning of a response-outcome association. We first allowed rats to lever press for palatable food pellets and stopped training rats once their behavior evidenced the response-outcome association (learners). We compared their food-seeking behavior and neuronal activation (Fos protein expression) to similarly trained rats that did not form this association (non-learners). Learners had greater food-seeking behavior and neuronal activation within the medial prefrontal cortex (mPFC), suggesting that mPFC subregions might encode initial food self-administration memories. To test the functional relevance of mPFC Fos-expressing ensembles to subsequent food seeking, we tested region-wide inactivation of the IL using muscimol+baclofen and neuronal ensemble-specific ablation using the Daun02 inactivation procedure. Both region-wide inactivation and ensemble-specific inactivation of the IL significantly decreased food seeking. These data suggest that IL neuronal ensembles form during initial learning of food self-administration behavior, and furthermore, that these ensembles play a functional role in food seeking.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Coordinated Prefrontal State Transition Leads Extinction of Reward-Seeking Behaviors

Extinction learning suppresses conditioned reward responses and is thus fundamental to adapt to changing environmental demands and to control excessive reward seeking. The medial prefrontal cortex (mPFC) monitors and controls conditioned reward responses. Abrupt transitions in mPFC activity anticipate changes in conditioned responses to altered contingencies. It remains, however, unknown whether such transitions are driven by the extinction of old behavioral strategies or by the acquisition of new competing ones. Using in vivo multiple single-unit recordings of mPFC in male rats, we studied the relationship between single-unit and population dynamics during extinction learning, using alcohol as a positive reinforcer in an operant conditioning paradigm. To examine the fine temporal relation between neural activity and behavior, we developed a novel behavioral model that allowed us to identify the number, onset, and duration of extinction-learning episodes in the behavior of each animal. We found that single-unit responses to conditioned stimuli changed even under stable experimental conditions and behavior. However, when behavioral responses to task contingencies had to be updated, unit-specific modulations became coordinated across the whole population, pushing the network into a new stable attractor state. Thus, extinction learning is not associated with suppressed mPFC responses to conditioned stimuli, but is anticipated by single-unit coordination into population-wide transitions of the internal state of the animal.SIGNIFICANCE STATEMENT The ability to suppress conditioned behaviors when no longer beneficial is fundamental for the survival of any organism. While pharmacological and optogenetic interventions have shown a critical involvement of the mPFC in the suppression of conditioned responses, the neural dynamics underlying such a process are still largely unknown. Combining novel analysis tools to describe behavior, single-neuron response, and population activity, we found that widespread changes in neuronal firing temporally coordinate across the whole mPFC population in anticipation of behavioral extinction. This coordination leads to a global transition in the internal state of the network, driving extinction of conditioned behavior.

Opposing Regulation of Cocaine Seeking by Glutamate and GABA Neurons in the Ventral Pallidum

Projections from the nucleus accumbens to the ventral pallidum (VP) regulate relapse in animal models of addiction. The VP contains GABAergic (VP_GABA) and glutamatergic (VP_Glu) neurons, and a subpopulation of GABAergic neurons co-express enkephalin (VP_Penk). Rabies tracing reveals that VP_Glu and VP_Penk neurons receive preferential innervation from upstream D1- relative to D2-expressing accumbens neurons. Chemogenetic stimulation of VP_Glu neurons inhibits, whereas stimulation of VP_GABA and VP_Penk neurons potentiates cocaine seeking in mice withdrawn from intravenous cocaine self-administration. Calcium imaging reveals cell type-specific activity patterns when animals learn to suppress drug seeking during extinction training versus engaging in cue-induced cocaine seeking. During cued seeking, VP_GABA neurons increase their overall activity, and VP_Penk neurons are selectively activated around nose pokes for cocaine. In contrast, VP_Glu neurons increase their spike rate following extinction training. These data show that VP subpopulations differentially encode and regulate cocaine seeking, with VP_Penk and VP_GABA neurons facilitating and VP_Glu neurons inhibiting cocaine seeking.

Heinsbroek et al. show that glutamate and GABA neurons in ventral pallidum differentially regulate cued cocaine seeking. Calcium activity in glutamate neurons increases when mice refrain from cocaine seeking. Activating glutamate neurons inhibits cocaine seeking. Calcium activity increases in GABA neurons during cocaine seeking, and activating GABA or enkephalin neurons induces cocaine seeking.

Alcohol reduces the activity of somatostatin interneurons in the mouse prefrontal cortex: A neural basis for its disinhibitory effect?

The prefrontal cortex (PFC) is involved in executive ("top-down") control of behavior and its function is especially susceptible to the effects of alcohol, leading to behavioral disinhibition that is associated with alterations in decision making, response inhibition, social anxiety and working memory. The circuitry of the PFC involves a complex interplay between pyramidal neurons (PNs) and several subclasses of inhibitory interneurons (INs), including somatostatin (SST)-expressing INs. Using in vivo calcium imaging, we showed that alcohol dose-dependently altered network activity in layers 2/3 of the prelimbic subregion of the mouse PFC. Low doses of alcohol (1 g/kg, intraperitoneal, i.p.) caused moderate activation of SST INs and weak inhibition of PNs. At moderate to high doses, alcohol (2-3 g/kg) strongly inhibited the activity of SST INs in vivo, and this effect may result in disinhibition, as the activity of a subpopulation of PNs was simultaneously enhanced. In contrast, recordings in brain slices using ex vivo electrophysiology revealed no direct effect of alcohol on the excitability of either SST INs or PNs over a range of concentrations (20 and 50 mM) consistent with the blood alcohol levels reached in the in vivo experiments. This dose-dependent effect of alcohol on SST INs in vivo may reveal a neural basis for the disinhibitory effect of alcohol in the PFC mediated by other neurons within or external to the PFC circuitry.

Motivational competition and the paraventricular thalamus

Although significant progress has been made in understanding the behavioral and brain mechanisms for motivational systems, much less is known about competition between motivational states or motivational conflict (e.g., approach - avoidance conflict). Despite being produced under diverse conditions, behavior during motivational competition has two signatures: bistability and metastability. These signatures reveal the operation of positive feedback mechanisms in behavioral selection. Different neuronal architectures can instantiate this selection to achieve bistability and metastability in behavior, but each relies on circuit-level inhibition to achieve rapid and stable selection between competing tendencies. Paraventricular thalamus (PVT) is identified as critical to this circuit level inhibition, resolving motivational competition via its extensive projections to local inhibitory networks in the ventral striatum and extended amygdala, enabling adaptive responding under motivational conflict.

Alcohol and sweet reward are encoded by distinct meta-ensembles

Cue-reward associations form distinct memories that can drive appetitive behaviors and cravings for both drugs and natural rewards. It is still unclear how such memories are encoded in the brain's reward system. We trained rats to concurrently self-administer either alcohol or a sweet saccharin solution as drug or natural rewards, respectively. Memory recall due to cue exposure reactivated reward-associated functional ensembles in reward-related brain regions, marked by a neural cFos response. While the local ensembles activated by cue presentation for either reward consisted of similar numbers of neurons, using advanced statistical network theory, we found robust reward-specific co-activation patterns across brain regions. Interestingly, the resulting meta-ensemble networks differed by the most influential regions, which in case of saccharin comprised the prefrontal cortex, while for alcohol seeking control shifted to insular cortex with strong involvement of the amygdala. Our results support the view of memory representation as a differential co-activation of local neuronal ensembles. This article is part of the special issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.

Prefrontal contributions to action control in rodents

The rodent medial prefrontal cortex (mPFC) is typically considered to be involved in cognitive aspects of action control, e.g., decision making, rule learning and application, working memory and generally guiding adaptive behavior (Euston, Gruber, & McNaughton, 2012). These cognitive aspects often occur on relatively slow time scales, i.e., in the order of several trials within a block structure (Murakami, Shteingart, Loewenstein, & Mainen, 2017). In this way, the mPFC is able to set up a representational memory (Goldman-Rakic, 1987). On the other hand, the mPFC can also impact action control more directly (i.e., more on the motoric and less cognitive side). This impact on motor control manifests on faster time scales, i.e., on a single trial level (Hardung et al., 2017). While the more cognitive aspects have been reviewed previously as well as in other subchapters of this book, we explicitly focus on the latter aspect in this chapter, particularly on movement inhibition. We discuss models of prefrontal motor interactions, the impact of the behavioral paradigm, evidences for mPFC involvement in action control, and the anatomical connections between mPFC and motor cortex.

Integration of value and action in medial prefrontal neural systems

The rodent medial prefrontal cortex (mPFC) plays a key role in regulating cognition, emotion, and behavior. mPFC neurons are activated in diverse experimental paradigms, raising the questions of whether there are specific task elements or dimensions encoded by mPFC neurons, and whether these encoded parameters are selective to neurons in particular mPFC subregions or networks. Here, we consider the role of mPFC neurons in processing appetitive and aversive cues, outcomes, and related behaviors. mPFC neurons are strongly activated in tasks probing value and outcome-associated actions, but these responses vary across experimental paradigms. Can we identify specific categories of responses (e.g., positive or negative value), or do mPFC neurons exhibit response properties that are too heterogeneous/complex to cluster into distinct conceptual groups? Based on a review of relevant studies, we consider what has been done and what needs to be further explored in order to address these questions.

The role of the ventromedial prefrontal cortex and context in regulating fear learning and extinction

An organism's ability to learn about and respond to stimuli in its environment is crucial for survival, which can involve learning simple associations such as learning what stimuli predict danger. However, individuals must also be able to use contextual information to adapt to changing environmental demands. While the circuitry that supports fear conditioning has been extensively studied, the circuitry that allows individuals to regulate fear under different circumstance is less well understood. A view of ventromedial prefrontal cortex (vmPFC) function has emerged wherein the prelimbic region of the vmPFC supports fear expression, while the infralimbic region supports fear inhibition. However, despite a rich literature exploring the role of these regions in appetitive learning and memory suggesting a more nuanced function, there has been little integration of this literature with studies of the vmPFC in fear learning. In this review, we argue that the function of the vmPFC in fear learning is not restricted to fear inhibition versus expression per se. Instead, the vmPFC uses contextual information to guide behavior, particularly in situations of ambiguity or conflict.

Different Multidimensional Representations across the Amygdalo-Prefrontal Network during an Approach-Avoidance Task

The prelimbic (PL) area and basolateral amygdala (lateral [LA] and basolateral [BL] nuclei) have closely related functions and similar extrinsic connectivity. Reasoning that the computational advantage of such redundancy should be reflected in differences in how these structures represent information, we compared the coding properties of PL and amygdala neurons during a task that requires rats to produce different conditioned defensive or appetitive behaviors. Rather than unambiguous regional differences in the identities of the variables encoded, we found gradients in how the same variables are represented. Whereas PL and BL neurons represented many different parameters through minor variations in firing rates, LA cells coded fewer task features with stronger changes in activity. At the population level, whereas valence could be easily distinguished from amygdala activity, PL neurons could distinguish both valence and trial identity as well as or better than amygdala neurons. Thus, PL has greater representational capacity.

Orbitofrontal Cortex Encodes Preference for Alcohol

Orbitofrontal cortex (OFC) plays a key role in representation and regulation of reward value, preference, and seeking. OFC function is disrupted in drug use and dependence, but its specific role in alcohol use disorders has not been thoroughly studied. In alcohol-dependent humans OFC activity is increased by alcohol cue presentation. Ethanol (EtOH) also alters OFC neuron excitability in vitro, and OFC manipulation influences EtOH seeking and drinking in rodents.

Orbitofrontal cortex (OFC) plays a key role in representation and regulation of reward value, preference, and seeking. OFC function is disrupted in drug use and dependence, but its specific role in alcohol use disorders has not been thoroughly studied. In alcohol-dependent humans OFC activity is increased by alcohol cue presentation. Ethanol (EtOH) also alters OFC neuron excitability in vitro, and OFC manipulation influences EtOH seeking and drinking in rodents. To understand the relationship between OFC function and individual alcohol use, we recorded OFC neuron activity in rats during EtOH self-administration, characterizing the neural correlates of individual preference for alcohol. After one month of intermittent access to 20% EtOH, male Long–Evans rats were trained to self-administer 20% EtOH, 10% EtOH, and 15% sucrose. OFC neuronal activity was recorded and associated with task performance and EtOH preference. Rats segregated into high and low EtOH drinkers based on homecage consumption and operant seeking of 20% EtOH. Motivation for 10% EtOH and sucrose was equally high in both groups. OFC neuronal activity was robustly increased or decreased during sucrose and EtOH seeking and consumption, and strength of changes in OFC activity was directly associated with individual preference for 20% EtOH. EtOH-associated OFC activity was more similar to sucrose-associated activity in high versus low EtOH drinkers. The results show that OFC neurons are activated during alcohol seeking based on individual preference, supporting this brain region as a potential substrate for alcohol motivation that may be dysregulated in alcohol misuse.

Pharmacological Inactivation of Medial Prefrontal Cortex Does Not Support Dichotomous "Go/Stop" Roles for Dorsal and Ventral Subdivisions in Natural Reward Seeking in Rats

Highlighted Research Paper:Differential Effects of Dorsal and Ventral Medial Prefrontal Cortex Inactivation during Natural Reward Seeking, Extinction, and Cue-Induced Reinstatement. Jessica P. Caballero, Garrett B. Scarpa, Luke Remage-Healey, David E. Moorman.

Infralimbic Cortex Biases Preference Decision Making for Offspring over Competing Cocaine-Associated Stimuli in New Mother Rats

In the context of drug abuse, converging evidence suggests that cocaine use in new mothers is significantly reduced by the competing motivation related to child rearing. Given the demonstrated importance of the medial prefrontal cortex (mPFC) in decision-making processes, we investigated the contribution of distinct regions of the mPFC [anterior cingulate (Cg1), prelimbic (PrL), infralimbic (IL)] to decision making in new mother rats performing a concurrent pup/cocaine choice conditioned place preference (CPP) task. When given a choice, inactivation of IL cortex significantly biased decision making of mother rats toward cocaine-associated cues, highly contrasting the distribution of preferences by control groups. In contrast, inactivation of PrL cortex had the opposite effect, significantly increasing offspring bias in the decision making, such that none of the mothers chose the cocaine-associated alternative. Cg1 inactivation was without effect. Functional inactivation of these same mPFC subregions had no effect in a non-conflict CPP task in which context-induced cocaine or pup seeking were examined separately. Notably, inactivation of the IL cortex also interfered with maternal behavior. Taken together, we have identified a specific role of the IL cortex in the prioritization of offspring over drug competing alternatives, thus promoting resistance to drug use in new mothers.