Neurons in rat orbitofrontal cortex and medial prefrontal cortex exhibit distinct responses in reward and strategy-update in a risk-based decision-making task

Orbitofrontal and Prelimbic Cortices Serve Complementary Roles in Adapting Reward Seeking to Learned Anxiety

BACKGROUND

Anxiety is a common symptom of several mental health disorders and adversely affects motivated behaviors. Anxiety can emerge from associating risk of future harm while engaged in goal-guided actions. Using a recently developed behavioral paradigm to model this aspect of anxiety, we investigated the role of 2 cortical subregions, the prelimbic medial frontal cortex (PL) and lateral orbitofrontal cortex (lOFC), which have been implicated in anxiety and outcome expectation, in flexible representation of actions associated with harm risk.

METHODS

A seek-take reward-guided instrumental task design was used to train animals (N = 8) to associate the seek action with a variable risk of punishment. After learning, animals underwent extinction training for this association. Fiber photometry was used to measure and compare neuronal activity in the PL and lOFC during learning and extinction.

RESULTS

Animals increased action suppression in response to punishment contingencies. This increase dissipated after extinction training. These behavioral changes were associated with region-specific changes in neuronal activity. PL neuronal activity preferentially adapted to the threat of punishment, whereas lOFC activity adapted to safe aspects of the task. Moreover, correlated activity between these regions was suppressed during actions associated with harm risk, suggesting that these regions may guide behavior independently under anxiety.

CONCLUSIONS

These findings suggest that the PL and lOFC serve distinct but complementary roles in the representation of learned anxiety. This dissociation may provide a mechanism to explain how overlapping cortical systems are implicated in reward-guided action execution during anxiety.

Noradrenergic regulation of cue-guided decision making and impulsivity is doubly dissociable across frontal brain regions

RATIONALE

Win-paired stimuli can promote risk taking in experimental gambling paradigms in both rats and humans. We previously demonstrated that atomoxetine, a noradrenaline reuptake inhibitor, and guanfacine, a selective α2A adrenergic receptor agonist, reduced risk taking on the cued rat gambling task (crGT), a rodent assay of risky choice in which wins are accompanied by salient cues. Both compounds also decreased impulsive premature responding.

OBJECTIVE

The key neural loci mediating these effects were unknown. The lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC), which are highly implicated in risk assessment, action selection, and impulse control, receive dense noradrenergic innervation. We therefore infused atomoxetine and guanfacine directly into either the lOFC or prelimbic (PrL) mPFC prior to task performance.

RESULTS

When infused into the lOFC, atomoxetine improved decision making score and adaptive lose-shift behaviour in males, but not in females, without altering motor impulsivity. Conversely, intra-PrL atomoxetine improved impulse control in risk preferring animals of both sexes, but did not alter decision making. Guanfacine administered into the PrL, but not lOFC, also altered motor impulsivity in all subjects, though in the opposite direction to atomoxetine.

CONCLUSIONS

These data highlight a double dissociation between the behavioural effects of noradrenergic signaling across frontal regions with respect to risky choice and impulsive action. Given that the influence of noradrenergic manipulations on motor impulsivity could depend on baseline risk preference, these data also suggest that the noradrenaline system may function differently in subjects that are susceptible to the risk-promoting lure of win-associated cues.

The distinct role of orbitofrontal and medial prefrontal cortex in encoding impulsive choices in an animal model of attention deficit hyperactivity disorder

Attention deficit hyperactivity disorder (ADHD) is a complex neurodevelopmental disorder affecting up to 5% of children worldwide. The lack of understanding of ADHD etiology prevented the development of effective treatment for the disease. Here, using in vivo electrophysiology recordings, we have recorded and analyzed the neuronal encoding of delay discounting behavior in prefrontal and orbitofrontal cortex of spontaneously hypertensive rat (SHR). We found that in the presence of rewards, neurons in the orbitofrontal cortex (OFC) were activated regardless to the value of the rewards and OFC neurons in SHR exhibited significantly higher rates of neuronal discharging towards the presence of rewards. While in the medial prefrontal cortex (mPFC), neurons of SHR responded similarly in the presence of large rewards compared with control rats whereas they displayed higher firing rates towards smaller rewards. In addition, the reward-predicting neurons in the OFC encodes for value of rewards in control animals and they were strongly activated upon receiving a small immediate reinforcer in the SHR whereas the reward-predicting neurons in the mPFC neurons generally did not respond to the value of the rewards. Our study characterized the neuronal discharging patterns of OFC and mPFC neurons in the SHR and the control animals and provided novel insights for further understanding the neuronal basis of ADHD pathology.

The role of the medial prefrontal cortex in cognition, ageing and dementia

Humans require a plethora of higher cognitive skills to perform executive functions, such as reasoning, planning, language and social interactions, which are regulated predominantly by the prefrontal cortex. The prefrontal cortex comprises the lateral, medial and orbitofrontal regions. In higher primates, the lateral prefrontal cortex is further separated into the respective dorsal and ventral subregions. However, all these regions have variably been implicated in several fronto-subcortical circuits. Dysfunction of these circuits has been highlighted in vascular and other neurocognitive disorders. Recent advances suggest the medial prefrontal cortex plays an important regulatory role in numerous cognitive functions, including attention, inhibitory control, habit formation and working, spatial or long-term memory. The medial prefrontal cortex appears highly interconnected with subcortical regions (thalamus, amygdala and hippocampus) and exerts top-down executive control over various cognitive domains and stimuli. Much of our knowledge comes from rodent models using precise lesions and electrophysiology readouts from specific medial prefrontal cortex locations. Although, anatomical disparities of the rodent medial prefrontal cortex compared to the primate homologue are apparent, current rodent models have effectively implicated the medial prefrontal cortex as a neural substrate of cognitive decline within ageing and dementia. Human brain connectivity-based neuroimaging has demonstrated that large-scale medial prefrontal cortex networks, such as the default mode network, are equally important for cognition. However, there is little consensus on how medial prefrontal cortex functional connectivity specifically changes during brain pathological states. In context with previous work in rodents and non-human primates, we attempt to convey a consensus on the current understanding of the role of predominantly the medial prefrontal cortex and its functional connectivity measured by resting-state functional MRI in ageing associated disorders, including prodromal dementia states, Alzheimer's disease, post-ischaemic stroke, Parkinsonism and frontotemporal dementia. Previous cross-sectional studies suggest that medial prefrontal cortex functional connectivity abnormalities are consistently found in the default mode network across both ageing and neurocognitive disorders such as Alzheimer's disease and vascular cognitive impairment. Distinct disease-specific patterns of medial prefrontal cortex functional connectivity alterations within specific large-scale networks appear to consistently feature in the default mode network, whilst detrimental connectivity alterations are associated with cognitive impairments independently from structural pathological aberrations, such as grey matter atrophy. These disease-specific patterns of medial prefrontal cortex functional connectivity also precede structural pathological changes and may be driven by ageing-related vascular mechanisms. The default mode network supports utility as a potential biomarker and therapeutic target for dementia-associated conditions. Yet, these associations still require validation in longitudinal studies using larger sample sizes.

Long-term Effects of Maternal Separation on Anxiety-Like Behavior and Neuroendocrine Parameters in Adult Balb/c Mice

Introduction: Disruption of maternal care using maternal separation (MS) models has provided significant evidence of the deleterious long-term effects of early life stress. Several preclinical studies investigating MS showed multiple behavioral and biomolecular alterations. However, there is still conflicting results from MS studies, which represents a challenge for reliability and replicability of those findings. Objective: To address that, this study was conducted to investigate whether MS would affect anxiety-like behaviors using a battery of classical tasks, as well as central and peripheral stress-related biomarkers. Methods: Male Balb/c mice were exposed to MS from postnatal day (PND) 2 to 14 for 180-min per day. Two independent cohorts were performed to evaluate both baseline and anxiety-like behavior responses to MS at PND60. We performed composite scores to evaluate MS effects on anxiety and risk assessment phenotypes. Also, we assessed mRNA gene expression in the medial pre-frontal cortex (mPFC) of glucocorticoid and mineralocorticoid receptors (GR and MR) using real-time PCR and peripheral corticosterone levels (CORT) to investigate possible neurobiological correlates to anxiety behaviors. Results: We found increased anxiety-like behavior and decreased risk assessment and exploratory behaviors in MS mice. The animals exposed to MS also presented a decrease in MR mRNA expression and higher levels of CORT compared to controls. Conclusions: Our findings reinforce the body of evidence suggesting that long-term MS induces effects on anxiety and risk assessment phenotypes following the exposure to a standardized MS protocol. Moreover, MS affected the expression of MR mRNA and induced significant changes on CORT response. This data highlights that the reprograming MS effects on HPA axis could be mediate by MR gene expression in mPFC and chronic overactivity of peripheral CORT levels.

Integration of value and action in medial prefrontal neural systems

The rodent medial prefrontal cortex (mPFC) plays a key role in regulating cognition, emotion, and behavior. mPFC neurons are activated in diverse experimental paradigms, raising the questions of whether there are specific task elements or dimensions encoded by mPFC neurons, and whether these encoded parameters are selective to neurons in particular mPFC subregions or networks. Here, we consider the role of mPFC neurons in processing appetitive and aversive cues, outcomes, and related behaviors. mPFC neurons are strongly activated in tasks probing value and outcome-associated actions, but these responses vary across experimental paradigms. Can we identify specific categories of responses (e.g., positive or negative value), or do mPFC neurons exhibit response properties that are too heterogeneous/complex to cluster into distinct conceptual groups? Based on a review of relevant studies, we consider what has been done and what needs to be further explored in order to address these questions.

Prefrontal Cortex Representation of Learning of Punishment Probability During Reward-Motivated Actions

Actions executed toward obtaining a reward are frequently associated with the probability of harm occurring during action execution. Learning this probability allows for appropriate computation of future harm to guide action selection. Impaired learning of this probability may be critical for the pathogenesis of anxiety or reckless and impulsive behavior. Here we designed a task for punishment probability learning during reward-guided actions to begin to understand the neuronal basis of this form of learning, and the biological or environmental variables that influence action selection after learning. Male and female Long-Evans rats were trained in a seek-take behavioral paradigm where the seek action was associated with varying probability of punishment. The take action remained safe and was followed by reward delivery. Learning was evident as subjects selectively adapted seek action behavior as a function of punishment probability. Recording of neural activity in the mPFC during learning revealed changes in phasic mPFC neuronal activity during risky-seek actions but not during the safe take actions or reward delivery, revealing that this region is involved in learning of probabilistic punishment. After learning, the variables that influenced behavior included reinforcer and punisher value, pretreatment with the anxiolytic diazepam, and biological sex. In particular, females were more sensitive to probabilistic punishment than males. These data demonstrate that flexible encoding of risky actions by mPFC is involved in probabilistic punishment learning and provide a novel behavioral approach for studying the pathogenesis of anxiety and impulsivity with inclusion of sex as a biological variable.SIGNIFICANCE STATEMENT Actions we choose to execute toward obtaining a reward are often associated with the probability of harm occurring. Impaired learning of this probability may be critical for the pathogenesis of anxiety or reckless behavior and impulsivity. We developed a behavioral model to assess this mode of learning. This procedure allowed us to determine biological and environmental factors that influence the resistance of reward seeking to probabilistic punishment and to identify the mPFC as a region that flexibly adapts its response to risky actions as contingencies are learned.