Neural correlates of rules and conflict in medial prefrontal cortex during decision and feedback epochs

Instinct to insight: Neural correlates of ethological strategy learning

In ethological behaviors like parenting, animals innately follow stereotyped patterns of choices to decide between uncertain outcomes but can learn to modify their strategies to incorporate new information. For example, female mice in a T-maze instinctively use spatial-memory to search for pups where they last found them but can learn more efficient strategies employing pup-associated acoustic cues. We uncovered neural correlates for transitioning between these innate and learned strategies. Auditory cortex (ACx) was required during learning. ACx firing at the nest increased with learning and correlated with subsequent search speed but not outcome. Surprisingly, ACx suppression rather than facilitation during search was more prognostic of correct sound-cued outcomes - even before adopting a sound-cued strategy. Meanwhile medial prefrontal cortex encoded the last pup location, but this decayed as the spatial-memory strategy declined. Our results suggest a neural competition between a weakening spatial-memory and strengthening sound-cued neural representation to mediate strategy switches.

Activation of prefrontal cortex and striatal regions in rats after shifting between rules in a T-maze

Prefrontal cortical and striatal areas have been identified by inactivation or lesion studies to be required for behavioral flexibility, including selecting and processing of different types of information. In order to identify these networks activated selectively during the acquisition of new reward contingency rules, rats were trained to discriminate orientations of bars presented in pseudorandom sequence on two video monitors positioned behind the goal sites on a T-maze with return arms. A second group already trained in the visual discrimination task learned to alternate left and right goal arm visits in the same maze while ignoring the visual cues still being presented. In each experimental group, once the rats reached criterion performance, the brains were prepared after a 90-min delay for later processing for c-fos immunohistochemistry. While both groups extinguished a prior strategy and acquired a new rule, they differed by the identity of the strategies and previous learning experience. Among the 28 forebrain areas examined, there were significant increases in the relative density of c-fos immunoreactive cell bodies after learning the second rule in the prefrontal cortex cingulate, the prelimbic and infralimbic areas, the dorsomedial striatum and the core of the nucleus accumbens, the ventral subiculum, and the central nucleus of the amygdala. These largely correspond to structures previously identified in inactivation studies, and their neurons fire synchronously during learning and strategy shifts. The data suggest that this dynamic network may underlie reward-based selection for action-a type of cognitive flexibility.

Acute psilocybin enhances cognitive flexibility in rats

Psilocybin has been shown to improve symptoms of depression and anxiety when combined with psychotherapy or other clinician-guided interventions. To understand the neural basis for this pattern of clinical efficacy, experimental and conceptual approaches that are different than traditional laboratory models of anxiety and depression are needed. A potential novel mechanism is that acute psilocybin improves cognitive flexibility, which then enhances the impact of clinician-assisted interventions. Consistent with this idea, we find that acute psilocybin robustly improves cognitive flexibility in male and female rats using a task where animals switched between previously learned strategies in response to uncued changes in the environment. Psilocybin did not influence Pavlovian reversal learning, suggesting that its cognitive effects are selective to enhanced switching between previously learned behavioral strategies. The serotonin (5HT) 2 A receptor antagonist ketanserin blocked psilocybin's effect on set-shifting, while a 5HT2C-selective antagonist did not. Ketanserin alone also improved set-shifting performance, suggesting a complex relationship between psilocybin's pharmacology and its impact on flexibility. Further, the psychedelic drug 2,5-Dimethoxy-4-iodoamphetamine (DOI) impaired cognitive flexibility in the same task, suggesting that this effect of psilocybin does not generalize to all other serotonergic psychedelics. We conclude that the acute impact of psilocybin on cognitive flexibility provides a useful behavioral model to investigate its neuronal effects relevant to its positive clinical outcome.

Acute psilocybin enhances cognitive flexibility in rats

Psilocybin has been shown to improve symptoms of depression and anxiety when combined with psychotherapy or other clinician-guided interventions. To understand the neural basis for this pattern of clinical efficacy, experimental and conceptual approaches that are different than traditional laboratory models of anxiety and depression are needed. A potential novel mechanism is that acute psilocybin improves cognitive flexibility, which then enhances the impact of clinician-assisted interventions. Consistent with this idea, we find that acute psilocybin robustly improves cognitive flexibility in male and female rats using a task where animals switched between previously learned strategies in response to uncued changes in the environment. Psilocybin did not influence Pavlovian reversal learning, suggesting that its cognitive effects are selective to enhanced switching between previously learned behavioral strategies. The serotonin (5HT) 2A receptor antagonist ketanserin blocked psilocybin's effect on set-shifting, while a 5HT2C-selective antagonist did not. Ketanserin alone also improved set-shifting performance, suggesting a complex relationship between psilocybin's pharmacology and its impact on flexibility. Further, the psychedelic drug 2,5-Dimethoxy-4-iodoamphetamine (DOI) impaired cognitive flexibility in the same task, suggesting that this effect of psilocybin does not generalize to all other serotonergic psychedelics. We conclude that the acute impact of psilocybin on cognitive flexibility provides a useful behavioral model to investigate its neuronal effects relevant to its positive clinical outcome.

The GluA1-Related BDNF Pathway Is Involved in PTSD-Induced Cognitive Flexibility Deficit in Attentional Set-Shifting Tasks of Rats

Background: Post-Traumatic Stress Disorder (PTSD) is a severe psychological disorder characterized by intrusive thoughts, heightened arousal, avoidance, and flashbacks. Cognitive flexibility dysfunction has been linked with the emergence of PTSD, including response inhibition deficits and impaired attentional switching, which results in difficulties for PTSD patients when disengaging attention from trauma-related stimuli. However, the molecular mechanisms of cognitive flexibility deficits remain unclear. Methods: The animals were exposed to a single prolonged stress and electric foot shock (SPS&S) procedure to induce PTSD-like features. Once the model was established, the changes in cognitive flexibility were assessed using an attentional set-shifting task (ASST) in order to investigate the effects of traumatic stress on cognitive flexibility. Additionally, the molecular alterations of certain proteins (AMPA Receptor 1 (GluA1), brain-derived neurotrophic factor (BDNF), and Postsynaptic density protein 95 (PSD95) in the medial prefrontal cortex (mPFC) were measured using Western blot and immunofluorescence. Results: The SPS&S model exhibited PTSD-like behaviors and induced reversal learning and set-shifting ability deficit in the ASST. These behavioral changes are accompanied by decreased GluA1, BDNF, and PSD95 protein expression in the mPFC. Further analysis showed a correlative relationship between the behavioral and molecular alterations. Conclusions: The SPS&S model induced cognitive flexibility deficits, and the potential underlying mechanism could be mediated by GluA1-related BDNF signaling in the mPFC.

Prelimbic cortex neural encoding dynamically tracks expected outcome value

Animals must modify their behavior based on updated expected outcomes in a changing environment. Prelimbic cortex (PrL) neural encoding during learning predicts, and is necessary for, appropriately altering behavior based on a new expected outcome value following devaluation. We aimed to determine how PrL neural activity encodes reward predictive cues after the expected outcome value of those cues is decreased following conditioned taste aversion. In one post-devaluation session, rats were tested under extinction to determine their ability to alter their behavior to the expected outcome values (i.e., extinction test). In a second post-devaluation session, rats were tested with the newly devalued outcome delivered so that the rats experienced the updated outcome value within the session (i.e., re-exposure test). We found that PrL neural encoding of the cue associated with the devalued reward predicted the ability of rats to suppress behavior in the extinction test session, but not in the re-exposure test session. While all rats were able to successfully devalue the outcome during conditioned taste aversion, a subset of rats continued to consume the devalued outcome in the re-exposure test session. We found differential patterns of PrL neural encoding in the population of rats that did not avoid the devalued outcome during the re-exposure test compared to the rats that successfully avoided the devalued outcome. Our findings suggest that PrL neural encoding dynamically tracks expected outcome values, and differential neural encoding in the PrL to reward predictive cues following expected outcome value changes may contribute to distinct behavioral phenotypes.

Dorsomedial prefrontal cortex activation disrupts Pavlovian incentive motivation

The dorsomedial prefrontal cortex (dmPFC) is known to make important contributions to flexible, reward-motivated behavior. However, it remains unclear if the dmPFC is involved in regulating the expression of Pavlovian incentive motivation, the process through which reward-paired cues promote instrumental reward-seeking behavior, which is modeled in rats using the Pavlovian-instrumental transfer (PIT) task. The current study examined this question using a bidirectional chemogenetic strategy in which inhibitory (hM4Di) or excitatory (hM3Dq) designer G-protein coupled receptors were virally expressed in dmPFC neurons, allowing us to later stimulate or inhibit this region by administering CNO prior to PIT testing. We found that dmPFC inhibition did not alter the tendency for a reward-paired cue to instigate instrumental reward-seeking behavior, whereas dmPFC stimulation disrupted the expression of this motivational influence. Neither treatment altered cue-elicited anticipatory activity at the reward-delivery port, indicating that dmPFC stimulation did not lead to more widespread motor suppression. A reporter-only control experiment indicated that our CNO treatment did not have non-specific behavioral effects. Thus, the dmPFC does not mediate the expression of Pavlovian incentive motivation but instead has the capacity to exert pronounced inhibitory control over this process, suggesting that it is involved in adaptively regulating cue-motivated behavior.

Compulsive alcohol drinking in rodents is associated with altered representations of behavioral control and seeking in dorsal medial prefrontal cortex

A key feature of compulsive alcohol drinking is continuing to drink despite negative consequences. To examine the changes in neural activity that underlie this behavior, compulsive alcohol drinking was assessed in a validated rodent model of heritable risk for excessive drinking (alcohol preferring (P) rats). Neural activity was measured in dorsal medial prefrontal cortex (dmPFC-a brain region involved in maladaptive decision-making) and assessed via change point analyses and novel principal component analyses. Neural population representations of specific decision-making variables were measured to determine how they were altered in animals that drink alcohol compulsively. Compulsive animals showed weakened representations of behavioral control signals, but strengthened representations of alcohol seeking-related signals. Finally, chemogenetic-based excitation of dmPFC prevented escalation of compulsive alcohol drinking. Collectively, these data indicate that compulsive alcohol drinking in rats is associated with alterations in dmPFC neural activity that underlie diminished behavioral control and enhanced seeking.

Event-based control of autonomic and emotional states by the anterior cingulate cortex

Despite being an intensive area of research, the function of the anterior cingulate cortex (ACC) remains somewhat of a mystery. Human imaging studies implicate the ACC in various cognitive functions, yet surgical ACC lesions used to treat emotional disorders have minimal lasting effects on cognition. An alternative view is that ACC regulates autonomic states, consistent with its interconnectivity with autonomic control regions and that stimulation evokes changes in autonomic/emotional states. At the cellular level, ACC neurons are highly multi-modal and promiscuous, and can represent a staggering array of task events. These neurons nevertheless combine to produce highly event-specific ensemble patterns that likely alter activity in downstream regions controlling emotional and autonomic tone. Since neuromodulators regulate the strength of the ensemble activity patterns, they would regulate the impact these patterns have on downstream targets. Through these mechanisms, the ACC may determine how strongly to react to the very events its ensembles represent. Pathologies arise when specific event-related representations gain excessive control over autonomic/emotional states.

Infralimbic cortex pyramidal neuron GIRK signaling contributes to regulation of cognitive flexibility but not affect-related behavior in male mice

Dysfunction of the infralimbic cortical (ILC) region of the medial prefrontal cortex (mPFC) is thought to be an underlying factor in both affect- and cognition-related behavioral deficits that co-occur across neuropsychiatric disorders. Increasing evidence highlights pathological imbalances in prefrontal pyramidal neuron excitability and associated aberrant firing as an underlying factor in this dysfunction. G protein-gated inwardly rectifying K⁺ (GIRK/Kir3) channels mediate excitability of mPFC pyramidal neurons, however the functional role of these channels in ILC-dependent regulation of behavior and pyramidal neuron excitation is unknown. The present study used a viral-cre approach in male mice harboring a 'floxed' version of the kcnj3 (Girk1) gene, to disrupt GIRK1-containing channel expression in pyramidal neurons within the ILC. Loss of GIRK1-dependent signaling increased excitability and spike firing of pyramidal neurons but did not alter affective behavior measured in an elevated plus maze, forced swim test, or progressive ratio test of motivation. Alternatively, ablation of GIRK1 impaired performance in an operant-based attentional set-shifting task designed to assess cognitive flexibility. These data highlight a unique role for GIRK1 signaling in ILC pyramidal neurons in the regulation of strategy shifting but not affect and suggest that these channels may represent a therapeutic target for treatment of cognitive deficits in neuropsychiatric disease.

Suppression of pyramidal neuron G protein-gated inwardly rectifying K+ channel signaling impairs prelimbic cortical function and underlies stress-induced deficits in cognitive flexibility in male, but not female, mice

Imbalance in prefrontal cortical (PFC) pyramidal neuron excitation:inhibition is thought to underlie symptomologies shared across stress-related disorders and neuropsychiatric disease, including dysregulation of emotion and cognitive function. G protein-gated inwardly rectifying K+ (GIRK/Kir3) channels mediate excitability of medial PFC pyramidal neurons, however, the functional role of these channels in mPFC-dependent regulation of affect, cognition, and cortical dynamics is unknown. We used a viral-cre approach in male and female mice harboring a "floxed" version of the kcnj3 (Girk1) gene, to disrupt GIRK1-containing channel expression in pyramidal neurons within the prelimbic cortex (PrL). In males, loss of pyramidal GIRK1-dependent signaling differentially impacted measures of affect and impaired working memory and cognitive flexibility. Unexpectedly, ablation of PrL GIRK1-dependent signaling did not impact affect or cognition in female mice. Additional studies used a model of chronic unpredictable stress (CUS) to determine the impact on PrL GIRK-dependent signaling and cognitive function. CUS exposure in male mice produced deficits in cognition that paralleled a reduction in PrL pyramidal GIRK-dependent signaling akin to viral approaches whereas CUS exposure in female mice did not alter cognitive flexibility performance. Stress-induced behavioral deficits in male mice were rescued by systemic injection of a novel, GIRK1-selective agonist, ML297. In conclusion, GIRK1-dependent signaling in male mice, but not females, is critical for maintaining optimal PrL function and behavioral control. Disruption of this inhibition may underlie stress-related dysfunction of the PrL and represent a therapeutic target for treating stress-induced deficits in affect regulation and impaired cognition that reduce quality of life.

Specialized coding patterns among dorsomedial prefrontal neuronal ensembles predict conditioned reward seeking

Non-overlapping cell populations within dorsomedial prefrontal cortex (dmPFC), defined by gene expression or projection target, control dissociable aspects of reward seeking through unique activity patterns. However, even within these defined cell populations, considerable cell-to-cell variability is found, suggesting that greater resolution is needed to understand information processing in dmPFC. Here, we use two-photon calcium imaging in awake, behaving mice to monitor the activity of dmPFC excitatory neurons throughout Pavlovian reward conditioning. We characterize five unique neuronal ensembles that each encodes specialized information related to a sucrose reward, reward-predictive cues, and behavioral responses to those cues. The ensembles differentially emerge across daily training sessions – and stabilize after learning – in a manner that improves the predictive validity of dmPFC activity dynamics for deciphering variables related to behavioral conditioning. Our results characterize the complex dmPFC neuronal ensemble dynamics that stably predict reward availability and initiation of conditioned reward seeking following cue-reward learning.

Prefrontal deep projection neurons enable cognitive flexibility via persistent feedback monitoring

Cognitive flexibility, the ability to alter strategy according to changing stimulus-response-reward relationships, is critical for updating learned behavior. Attentional set-shifting, a test of cognitive flexibility, depends on the activity of prefrontal cortex (PFC). It remains unclear, however, what role PFC neurons play to support set-shifting. Using optogenetics and two-photon calcium imaging, we demonstrate that medial PFC activity does not bias sensorimotor responses during set-shifting, but rather enables set-shifting by encoding trial feedback information, a role it has been known to play in other contexts. Unexpectedly, the functional properties of PFC cells did not vary with their efferent projection targets. Instead, representations of trial feedback formed a topological gradient, with cells more strongly selective for feedback information located further from the pial surface, where afferent input from the anterior cingulate cortex was denser. These findings identify a critical role for deep PFC projection neurons in enabling set-shifting through behavioral feedback monitoring.

The anterior cingulate cortex and event-based modulation of autonomic states

In spite of being an intensive area of research focus, the anterior cingulate cortex (ACC) remains somewhat of an enigma. Many theories have focused on its role in various aspects of cognition yet surgically precise lesions of the ACC, used to treat severe emotional disorders in human patients, typically have no lasting effects on cognition. An alternative view is that the ACC has a prominent role in regulating autonomic states. This view is consistent with anatomical data showing that a main target of the ACC are regions involved in autonomic control and with the observation that stimulation of the ACC evokes changes in autonomic states in both animals and humans. From an electrophysiological perspective, ACC neurons appear able to represent virtually any event or internal state, even though there is not always a strong link between these representations and behavior. Ensembles of neurons form robust contextual representations that strongly influence how specific events are encoded. The activity patterns associated with these contextually-based event representations presumably impact activity in downstream regions that control autonomic state. As a result, the ACC may regulate the autonomic and perhaps emotional reactions to events it is representing. This event-based control of autonomic tone by the ACC would likely arise during all types of cognitive and affective processes, without necessarily being critical for any of them.

Effects of choice on neuronal activity in anterior cingulate, prelimbic, and infralimbic cortices in the rat: Comparison of serial lever pressing with delayed nonmatching to position

The ability to choose between response alternatives based on their likely consequences depends on distributed neural circuits that involve rodent medial prefrontal cortex (mPFC). To understand the effects of choice on mPFC function, we compared the activity of mPFC neurons in rats performing two tasks: dynamic delayed nonmatching to position (dDNMTP), a task with a prefrontal-dependent conditional choice, and serial lever pressing (SLP), a task lacking a choice but trained in the same apparatus with sequences of actions and reinforcements matched to dDNMTP. More neurons exhibited event-related responses during dDNMTP than SLP. Average firing rate during recording sessions was higher during dDNMTP for neurons with event-related responses, but lower for neurons with activity unrelated to behavioural events. Thus, compared to SLP, dDNMTP appears to enhance the activity of neurons that represent behaviourally relevant information and to suppress the activity of neurons that do not. dDNMTP was associated with responses related to preparation and memory delay that were not observed during SLP as well as enhanced responses related to movement and reinforcement. These results provide evidence that choice in the dDNMTP task is associated with adaptive changes in background firing rates and coding properties of mPFC neurons.

Impaired instrumental reversal learning is associated with increased medial prefrontal cortex activity in Sapap3 knockout mouse model of compulsive behavior

Convergent functional neuroimaging findings implicate hyperactivity across the prefrontal cortex (PFC) and striatum in the neuropathology of obsessive compulsive disorder (OCD). The impact of cortico-striatal circuit hyperactivity on executive functions subserved by these circuits is unclear, because impaired recruitment of PFC has also been observed in OCD patients during paradigms assessing cognitive flexibility. To investigate the relationship between cortico-striatal circuit disturbances and cognitive functioning relevant to OCD, Sapap3 knockout mice (KOs) and littermate controls were tested in an instrumental reversal-learning paradigm to assess cognitive flexibility. Cortical and striatal activation associated with reversal learning was assessed via quantitative analysis of expression of the immediate early gene cFos and generalized linear mixed-effects models. Sapap3-KOs displayed heterogeneous reversal-learning performance, with almost half (n = 13/28) failing to acquire the reversed contingency, while the other 15/28 had similar acquisition as controls. Notably, reversal impairments were not correlated with compulsive grooming severity. cFos analysis revealed that reversal performance declined as medial PFC (mPFC) activity increased in Sapap3-KOs. No such relationship was observed in controls. Our studies are among the first to describe cognitive impairments in a transgenic OCD-relevant model, and demonstrate pronounced heterogeneity among Sapap3-KOs. These findings suggest that increased neural activity in mPFC is associated with impaired reversal learning in Sapap3-KOs, providing a likely neural basis for this observed heterogeneity. The Sapap3-KO model is thus a useful tool for future mechanistic studies to determine how mPFC hyperactivity contributes to OCD-relevant cognitive dysfunction.

A Visual Two-Choice Rule-Switch Task for Head-Fixed Mice

Cognitive flexibility is the innate ability of the brain to change mental processes and to modify behavioral responses according to an ever-changing environment. As our brain has a limited capacity to process the information of our surroundings in any given moment, it uses sets as a strategy to aid neural processing systems. With assessing the capability of shifting between task sets, it is possible to test cognitive flexibility and executive functions. The most widely used neuropsychological task for the evaluation of these functions in humans is the Wisconsin Card Sorting Test (WCST), which requires the subject to alter response strategies and use previously irrelevant information to solve a problem. The test has proven clinical relevance, as poor performance has been reported in multiple neuropsychiatric conditions. Although, similar tasks have been used in pre-clinical rodent research, many are limited because of their manual-based testing procedures and their hardware attenuates neuronal recordings. We developed a two-choice rule-switch task whereby head-fixed C57BL/6 mice had to choose correctly one of the two virtual objects presented to retrieve a small water reward. The animals learnt to discriminate the visual cues and they successfully switched their strategies according to the related rules. We show that reaching successful performance after the rule changes required more trials in this task and that animals took more time to execute decisions when the two rules were in conflict. We used optogenetics to inhibit temporarily the medial prefrontal cortex (mPFC) during reward delivery and consumption, which significantly increased the number of trials needed to perform the second rule successfully (i.e., succeed in switching between rules), compared to control experiments. Furthermore, by assessing two types of error animals made after the rule switch, we show that interfering with the positive feedback integration, but leaving the negative feedback processing intact, does not influence the initial disengagement from the first rule, but impedes the maintenance of the newly acquired response set. These findings support the role of prefrontal networks in mice for cognitive flexibility, which is impaired during numerous neuropsychiatric diseases, such as schizophrenia and depression.

The Rat Medial Prefrontal Cortex Exhibits Flexible Neural Activity States during the Performance of an Odor Span Task

Medial prefrontal cortex (mPFC) activity is fundamental for working memory (WM), attention, and behavioral inhibition; however, a comprehensive understanding of the neural computations underlying these processes is still forthcoming. Toward this goal, neural recordings were obtained from the mPFC of awake, behaving rats performing an odor span task of WM capacity. Neural populations were observed to encode distinct task epochs and the transitions between epochs were accompanied by abrupt shifts in neural activity patterns. Putative pyramidal neuron activity increased earlier in the delay for sessions where rats achieved higher spans. Furthermore, increased putative interneuron activity was only observed at the termination of the delay thus indicating that local processing in inhibitory networks was a unique feature to initiate foraging. During foraging, changes in neural activity patterns associated with the approach to a novel odor, but not familiar odors, were robust. Collectively, these data suggest that distinct mPFC activity states underlie the delay, foraging, and reward epochs of the odor span task. Transitions between these states likely enables adaptive behavior in dynamic environments that place strong demands on the substrates of working memory.

The impact of drugs of abuse on executive function: characterizing long-term changes in neural correlates following chronic drug exposure and withdrawal in rats

Addiction has long been characterized by diminished executive function, control, and impulsivity management. In particular, these deficits often manifest themselves as impairments in reversal learning, delay discounting, and response inhibition. Understanding the neurobiological substrates of these behavioral deficits is of paramount importance to our understanding of addiction. Within the cycle of addiction, periods during and after withdrawal represent a particularly difficult point of intervention in that the negative physical symptoms associated with drug removal and drug craving increase the likelihood that the patient will relapse and return to drug use in order to abate these symptoms. Moreover, it is often during this time that drug induced deficits in executive function hinder the ability of the patient to refrain from drug use. Thus, it is necessary to understand the physiological and behavioral changes associated with withdrawal and drug craving-largely manifesting as deficits in executive control-to develop more effective treatment strategies. In this review, we address the long-term impact that drugs of abuse have on the behavioral and neural correlates that give rise to executive control as measured by reversal learning, delay discounting, and stop-signal tasks, focusing particularly on our work using rats as a model system.

Conflict and adaptation signals in the anterior cingulate cortex and ventral tegmental area

The integration and utilization of feedback in order to determine which decision strategy to use in different contexts is the core of executive function. The anterior cingulate cortex (ACC) is central to these processes but how feedback is made available to the ACC is unclear. To address this question, we trained rats with implants in the ACC and the ventral tegmental area (VTA), a dopaminergic brain region implicated in feedback processing, in a spatial decision reversal task with rule switching occurring approximately every 12 trials. Following a rule switch, the rats had to shift and sustain responses to the alternative side in order to obtain reward. Partial directed coherence (PDC) models of signal directionality between the ACC and VTA indicated that VTA → ACC communication (near 4 Hz) increased immediately prior to incorrect choices and during post-error decisions. This increase did not occur during correct choices. These data indicate that the VTA provides a feedback-driven, bottom-up modulating signal to the ACC which may be involved in assessing, and correcting for, decision conflict.

Fluid network dynamics in the prefrontal cortex during multiple strategy switching

Coordinated shifts of neuronal activity in the prefrontal cortex are associated with strategy adaptations in behavioural tasks, when animals switch from following one rule to another. However, network dynamics related to multiple-rule changes are scarcely known. We show how firing rates of individual neurons in the prelimbic and cingulate cortex correlate with the performance of rats trained to change their navigation multiple times according to allocentric and egocentric strategies. The concerted population activity exhibits a stable firing during the performance of one rule but shifted to another neuronal firing state when a new rule is learnt. Interestingly, when the same rule is presented a second time within the same session, neuronal firing does not revert back to the original neuronal firing state, but a new activity-state is formed. Our data indicate that neuronal firing of prefrontal cortical neurons represents changes in strategy and task-performance rather than specific strategies or rules.

Population activity of neurons in the prefrontal cortex has been shown to represent cognitive strategy and rules. Here the authors report that when the same rule is repeated on multiple occasions in the task, it is accompanied each time by a new prefrontal firing rate state.

Distinct Sources of Deterministic and Stochastic Components of Action Timing Decisions in Rodent Frontal Cortex

The selection and timing of actions are subject to determinate influences such as sensory cues and internal state as well as to effectively stochastic variability. Although stochastic choice mechanisms are assumed by many theoretical models, their origin and mechanisms remain poorly understood. Here we investigated this issue by studying how neural circuits in the frontal cortex determine action timing in rats performing a waiting task. Electrophysiological recordings from two regions necessary for this behavior, medial prefrontal cortex (mPFC) and secondary motor cortex (M2), revealed an unexpected functional dissociation. Both areas encoded deterministic biases in action timing, but only M2 neurons reflected stochastic trial-by-trial fluctuations. This differential coding was reflected in distinct timescales of neural dynamics in the two frontal cortical areas. These results suggest a two-stage model in which stochastic components of action timing decisions are injected by circuits downstream of those carrying deterministic bias signals.

Adaptive Encoding of Outcome Prediction by Prefrontal Cortex Ensembles Supports Behavioral Flexibility

The prefrontal cortex (PFC) is thought to play a critical role in behavioral flexibility by monitoring action-outcome contingencies. How PFC ensembles represent shifts in behavior in response to changes in these contingencies remains unclear. We recorded single-unit activity and local field potentials in the dorsomedial PFC (dmPFC) of male rats during a set-shifting task that required them to update their behavior, among competing options, in response to changes in action-outcome contingencies. As behavior was updated, a subset of PFC ensembles encoded the current trial outcome before the outcome was presented. This novel outcome-prediction encoding was absent in a control task, in which actions were rewarded pseudorandomly, indicating that PFC neurons are not merely providing an expectancy signal. In both control and set-shifting tasks, dmPFC neurons displayed postoutcome discrimination activity, indicating that these neurons also monitor whether a behavior is successful in generating rewards. Gamma-power oscillatory activity increased before the outcome in both tasks but did not differentiate between expected outcomes, suggesting that this measure is not related to set-shifting behavior but reflects expectation of an outcome after action execution. These results demonstrate that PFC neurons support flexible rule-based action selection by predicting outcomes that follow a particular action.SIGNIFICANCE STATEMENT Tracking action-outcome contingencies and modifying behavior when those contingencies change is critical to behavioral flexibility. We find that ensembles of dorsomedial prefrontal cortex neurons differentiate between expected outcomes when action-outcome contingencies change. This predictive mode of signaling may be used to promote a new response strategy at the service of behavioral flexibility.

Role of Anterior Cingulate Cortex in Instrumental Learning: Blockade of Dopamine D1 Receptors Suppresses Overt but Not Covert Learning

HIGHLIGHTS

Blockade of dopamine D1 receptors in ACC suppressed instrumental learning when overt responding was required.

Covert learning through observation was not impaired.

After treatment with a dopamine antagonist, instrumental learning recovered but not the rat's pretreatment level of effort tolerance.

ACC dopamine is not necessary for acquisition of task-relevant cues during learning, but regulates energy expenditure and effort based decision.

Dopamine activity in anterior cingulate cortex (ACC) is essential for various aspects of instrumental behavior, including learning and effort based decision making. To dissociate learning from physical effort, we studied both observational (covert) learning, and trial-and-error (overt) learning. If ACC dopamine activity is required for task acquisition, its blockade should impair both overt and covert learning. If dopamine is not required for task acquisition, but solely for regulating the willingness to expend effort for reward, i.e., effort tolerance, blockade should impair overt learning but spare covert learning. Rats learned to push a lever for food rewards either with or without prior observation of an expert conspecific performing the same task. Before daily testing sessions, the rats received bilateral ACC microinfusions of SCH23390, a dopamine D1 receptor antagonist, or saline-control infusions. We found that dopamine blockade suppressed overt responding selectively, leaving covert task acquisition through observational learning intact. In subsequent testing sessions without dopamine blockade, rats recovered their overt-learning capacity but not their pre-treatment level of effort tolerance. These results suggest that ACC dopamine is not required for the acquisition of conditioned behaviors and that apparent learning impairments could instead reflect a reduced level of willingness to expend effort due to cortical dopamine blockade.

Effects of stress on behavioral flexibility in rodents

Cognitive flexibility is the ability to switch between different rules or concepts and behavioral flexibility is the overt physical manifestation of these shifts. Behavioral flexibility is essential for adaptive responses and commonly measured by reversal learning and set-shifting performance in rodents. Both tasks have demonstrated vulnerability to stress with effects dependent upon stressor type and number of repetitions. This review compares the effects of stress on reversal learning and set-shifting to provide insight into the differential effect of stress on cognition. Acute and short-term repetition of stress appears to facilitate reversal learning whereas the longer term repetition of stress impairs reversal learning. Stress facilitated intradimensional set-shifting within a single, short-term stress protocol but otherwise generally impaired set-shifting performance in acute and repeated stress paradigms. Chronic unpredictable stress impairs reversal learning and set-shifting whereas repeated cold intermittent stress selectively impairs reversal learning and has no effect on set-shifting. In considering the mechanisms underlying the effects of stress on behavioral flexibility, pharmacological manipulations performed in conjunction with stress are also reviewed. Blocking corticosterone receptors does not affect the facilitation of reversal learning following acute stress but the prevention of corticosterone synthesis rescues repeated stress-induced set-shifting impairment. Enhancing post-synaptic norepinephrine function, serotonin availability, and dopamine receptor activation rescues and/or prevents behavioral flexibility performance following stress. While this review highlights a lack of a standardization of stress paradigms, some consistent effects are apparent. Future studies are necessary to specify the mechanisms underlying the stress-induced impairments of behavioral flexibility, which will aid in alleviating these symptoms in patients with some psychiatric disorders.

Lateral habenula integration of proactive and retroactive information mediates behavioral flexibility

The lateral habenula (LHb) is known to play an important role in signaling aversive or adverse events that have happened or are predicted by cues under Pavlovian conditions. In rodents, it is also required for behavioral flexibility when changes in reward outcomes signal that strategies should be changed. It is not known whether the LHb also controls appetitive behaviors when an animal is able to utilize external cues proactively to guide upcoming decisions. In order to test this, male Long-Evans rats were trained to switch between two arms of a figure eight maze based on the tone presented prior to the choice. Importantly, the tones were switched every three to six trials so rats were able establish a response pattern before being required to switch. This caused rats to rely on both proactive (tones) and retroactive information (reward feedback) to guide behavior. Inactivation of the LHb with the GABA agonists baclofen and muscimol impaired overall performance by increasing both errors when the tones are switched (switch errors) as well as on subsequent trials (perseverative errors) indicating that both proactive and retroactive information are utilized by the LHb to guide behavioral flexibility. Once a correct choice was made in a given block, LHb inactivated rats did not make more errors than controls. A control study revealed that the LHb is not required for tone or reward magnitude discrimination per se. These results demonstrate for the first time that the LHb contributes to behavioral flexibility through utilizing both proactive and retroactive information when performing appetitive tasks.

Neurophysiology of rule switching in the corticostriatal circuit

The ability to adjust behavioral responses to cues in a changing environment is crucial for survival. Activity in the medial Prefrontal Cortex (mPFC) is thought to both represent rules to guide behavior as well as detect and resolve conflicts between rules in changing contingencies. While lesion and pharmacological studies have supported a crucial role for mPFC in this type of set-shifting, an understanding of how mPFC represents current rules or detects and resolves conflict between different rules is still unclear. Meanwhile, medial dorsal striatum (mDS) receives major projections from mPFC and neural activity of mDS is closely linked to action selection, making the mDS a potential major player for enacting rule-guided action policies. However, exactly what is signaled by mPFC and how this impacts neural signals in mDS is not well known. In this review, we will summarize what is known about neural signals of rules and set shifting in both prefrontal cortex and dorsal striatum, as well as provide questions and directions for future experiments.