Contribution of the prefrontal cortex and basolateral amygdala to behavioral decision-making under reward/punishment conflict

Infralimbic cortex plays a similar role in the punishment and extinction of instrumental behavior

Learning to stop responding is a fundamental process in instrumental learning. Animals may learn to stop responding under a variety of conditions that include punishment-where the response earns an aversive stimulus in addition to a reinforcer-and extinction-where a reinforced response now earns nothing at all. Recent research suggests that punishment and extinction may be related manifestations of a common retroactive interference process. In both paradigms, animals learn to stop performing a specific response in a specific context, suggesting direct inhibition of the response by the context. This process may depend on the infralimbic cortex (IL), which has been implicated in a variety of interference-based learning paradigms including extinction and habit learning. Despite the behavioral parallels between extinction and punishment, a corresponding role for IL in punishment has not been identified. Here we report that, in a simple arrangement where either punishment or extinction was conducted in a context that differed from the context in which the behavior was first acquired, IL inactivation reduced response suppression in the inhibitory context, but not responding when it "renewed" in the original context. In a more complex arrangement in which two responses were first trained in different contexts and then extinguished or punished in the opposite one, IL inactivation had no effect. The results advance our understanding of the effects of IL in retroactive interference and the behavioral mechanisms that can produce suppression of a response.

Activation patterns in male and female forebrain circuitries during food consumption under novelty

The influence of novelty on feeding behavior is significant and can override both homeostatic and hedonic drives due to the uncertainty of potential danger. Previous work found that novel food hypophagia is enhanced in a novel environment and that males habituate faster than females. The current study's aim was to identify the neural substrates of separate effects of food and context novelty. Adult male and female rats were tested for consumption of a novel or familiar food in either a familiar or in a novel context. Test-induced Fos expression was measured in the amygdalar, thalamic, striatal, and prefrontal cortex regions that are important for appetitive responding, contextual processing, and reward motivation. Food and context novelty induced strikingly different activation patterns. Novel context induced Fos robustly in almost every region analyzed, including the central (CEA) and basolateral complex nuclei of the amygdala, the thalamic paraventricular (PVT) and reuniens nuclei, the nucleus accumbens (ACB), the medial prefrontal cortex prelimbic and infralimbic areas, and the dorsal agranular insular cortex (AI). Novel food induced Fos in a few select regions: the CEA, anterior basomedial nucleus of the amygdala, anterior PVT, and posterior AI. There were also sex differences in activation patterns. The capsular and lateral CEA had greater activation for male groups and the anterior PVT, ACB ventral core and shell had greater activation for female groups. These activation patterns and correlations between regions, suggest that distinct functional circuitries control feeding behavior when food is novel and when eating occurs in a novel environment.

DREADD activation of the lateral orbitofrontal increases cocaine-taking and cocaine-seeking in male and female rats during intermittent access self-administration under risky conditions

Addiction is a disorder that can be characterized in part as the constant pursuit of a particular substance despite negative consequences. Although the orbitofrontal cortex (OFC) is known to regulate risk-taking more generally and be critical to the development of addiction, its role in regulating drug use under risk-taking conditions is unknown. To address this, we examined drug-taking and drug-seeking in male and female rats under conditions where cocaine infusions were paired with foot shock punishment 50% of the time and combined this paradigm with cFos immunohistochemistry. We found that rats that showed higher levels of drug-taking and drug-seeking prior to punishment showed decreased responding during self-administration sessions under risky conditions and lower levels of c-Fos expression in the lateral but not medial OFC. However, despite these initial differences in responses to infusions paired with foot shocks, all rats showed decreased responding with additional punishment sessions. We then used chemogenetic viral approaches to examine how altering activity of the lateral OFC affects drug-taking and drug-seeking during punished drug use. Although there was no effect of Gi/o DREADD-mediated inhibition of the lateral OFC on these behaviors, Gq DREADD-mediated activation increased drug-taking and drug-seeking when drug use was associated with foot shock 50% of the time. Interestingly, this manipulation had no effect on non-risky self-administration behavior. These results suggest that the involvement of lateral OFC in cocaine use is context-sensitive and influences decision-making based on negative outcomes.

A neural circuit for regulating a behavioral switch in response to prolonged uncontrollability in mice

Persistence in the face of failure helps to overcome challenges. But the ability to adjust behavior or even give up when the task is uncontrollable has advantages. How the mammalian brain switches behavior when facing uncontrollability remains an open question. We generated two mouse models of behavioral transition from action to no-action during exposure to a prolonged experience with an uncontrollable outcome. The transition was not caused by pain desensitization or muscle fatigue and was not a depression-/learned-helplessness-like behavior. Noradrenergic neurons projecting to GABAergic neurons within the orbitofrontal cortex (OFC) are key regulators of this behavior. Fiber photometry, microdialysis, mini-two-photon microscopy, and tetrode/optrode in vivo recording in freely behaving mice revealed that the reduction of norepinephrine and downregulation of alpha 1 receptor in the OFC reduced the number and activity of GABAergic neurons necessary for driving action behavior resulting in behavioral transition. These findings define a circuit governing behavioral switch in response to prolonged uncontrollability.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

Fast Detection of Snakes and Emotional Faces in the Macaque Amygdala

Primate vision is reported to detect snakes and emotional faces faster than many other tested stimuli. Because the amygdala has been implicated in avoidance and emotional behaviors to biologically relevant stimuli and has neural connections with subcortical nuclei involved with vision, amygdalar neurons would be sensitive to snakes and emotional faces. In this study, neuronal activity in the amygdala was recorded from Japanese macaques (Macaca fuscata) during discrimination of eight categories of visual stimuli including snakes, monkey faces, human faces, carnivores, raptors, non-predators, monkey hands, and simple figures. Of 527 amygdalar neurons, 95 responded to one or more stimuli. Response characteristics of the amygdalar neurons indicated that they were more sensitive to the snakes and emotional faces than other stimuli. Response magnitudes and latencies of amygdalar neurons to snakes and monkey faces were stronger and faster than those to the other categories of stimuli, respectively. Furthermore, response magnitudes to the low pass-filtered snake images were larger than those to scrambled snake images. Finally, analyses of population activity of amygdalar neurons suggest that snakes and emotional faces were represented separately from the other stimuli during the 50–100 ms period from stimulus onset, and neutral faces during the 100–150 ms period. These response characteristics indicate that the amygdala processes fast and coarse visual information from emotional faces and snakes (but not other predators of primates) among the eight categories of the visual stimuli, and suggest that, like anthropoid primate visual systems, the amygdala has been shaped over evolutionary time to detect appearance of potentially threatening stimuli including both emotional faces and snakes, the first of the modern predators of primates.

Over-representation of fundamental decision variables in the prefrontal cortex underlies decision bias

The brain is organized into anatomically distinct structures consisting of a variety of projection neurons. While such evolutionarily conserved neural circuit organization underlies the innate ability of animals to swiftly adapt to environments, they can cause biased cognition and behavior. Although recent studies have begun to address the causal importance of projection-neuron types as distinct computational units, it remains unclear how projection types are functionally organized in encoding variables during cognitive tasks. This review focuses on the neural computation of decision making in the prefrontal cortex and discusses what decision variables are encoded by single neurons, neuronal populations, and projection type, alongside how specific projection types constrain decision making. We focus particularly on "over-representations" of distinct decision variables in the prefrontal cortex that reflect the biological and subjective significance of the variables for the decision makers. We suggest that task-specific over-representation in the prefrontal cortex involves the refinement of the given decision making, while generalized over-representation of fundamental decision variables is associated with suboptimal decision biases, including pathological ones such as those in patients with psychiatric disorders. Such over-representation of the fundamental decision variables in the prefrontal cortex appear to be tightly constrained by afferent and efferent connections that can be optogenetically intervened on. These ideas may provide critical insights into potential therapeutic targets for psychiatric disorders, including addiction and depression.

Advances in understanding meso-cortico-limbic-striatal systems mediating risky reward seeking

The risk of an aversive consequence occurring as the result of a reward-seeking action can have a profound effect on subsequent behavior. Such aversive events can be described as punishers, as they decrease the probability that the same action will be produced again in the future and increase the exploration of less risky alternatives. Punishment can involve the omission of an expected rewarding event ("negative" punishment) or the addition of an unpleasant event ("positive" punishment). Although many individuals adaptively navigate situations associated with the risk of negative or positive punishment, those suffering from substance use disorders or behavioral addictions tend to be less able to curtail addictive behaviors despite the aversive consequences associated with them. Here, we discuss the psychological processes underpinning reward seeking despite the risk of negative and positive punishment and consider how behavioral assays in animals have been employed to provide insights into the neural mechanisms underlying addictive disorders. We then review the critical contributions of dopamine signaling to punishment learning and risky reward seeking, and address the roles of interconnected ventral striatal, cortical, and amygdala regions to these processes. We conclude by discussing the ample opportunities for future study to clarify critical gaps in the literature, particularly as related to delineating neural contributions to distinct phases of the risky decision-making process.

Medial prefrontal cortical control of reward- and aversion-based behavioral output: Bottom-up modulation

How does the brain guide our actions? This is a complex issue, where the medial prefrontal cortex (mPFC) plays a crucial role. The mPFC is essential for cognitive flexibility and decision making. These functions are related to reward- and aversion-based learning, which ultimately drive behavior. Though, cortical projections and modulatory systems that may regulate those processes in the mPFC are less understood. How does the mPFC regulate approach-avoidance behavior in the case of conflicting aversive and appetitive stimuli? This is likely dependent on the bottom-up neuromodulation of the mPFC projection neurons. In this review, we integrate behavioral-, pharmacological-, and viral-based circuit manipulation data showing the involvement of mPFC dopaminergic, noradrenergic, cholinergic, and serotoninergic inputs in reward and aversion processing. Given that an incorrect balance of reward and aversion value could be a key problem in mental diseases such as substance use disorders, we discuss outstanding questions for future research on the role of mPFC modulation in reward and aversion.