Basolateral Amygdala to Orbitofrontal Cortex Projections Enable Cue-Triggered Reward Expectations

Amygdala and Cortex Relationships during Learning of a Sensory Discrimination Task

During learning of a sensory discrimination task, the cortical and subcortical regions display complex spatiotemporal dynamics. During learning, both the amygdala and cortex link stimulus information to its appropriate association, for example, a reward. In addition, both structures are also related to nonsensory parameters such as body movements and licking during the reward period. However, the emergence of the cortico-amygdala relationships during learning is largely unknown. To study this, we combined wide-field cortical imaging with fiber photometry to simultaneously record cortico-amygdala population dynamics as male mice learn a whisker-dependent go/no-go task. We were able to simultaneously record neuronal populations from the posterior cortex and either the basolateral amygdala (BLA) or central/medial amygdala (CEM). Prior to learning, the somatosensory and associative cortex responded during sensation, while amygdala areas did not show significant responses. As mice became experts, amygdala responses emerged early during the sensation period, increasing in the CEM, while decreasing in the BLA. Interestingly, amygdala and cortical responses were associated with task-related body movement, displaying significant responses ∼200 ms before movement initiation which led to licking for the reward. A correlation analysis between the cortex and amygdala revealed negative and positive correlation with the BLA and CEM, respectively, only in the expert case. These results imply that learning induces an involvement of the cortex and amygdala which may aid to link sensory stimuli with appropriate associations.

Serotonin transporter knockout in rats reduces beta- and gamma-band functional connectivity between the orbitofrontal cortex and amygdala during auditory discrimination

The orbitofrontal cortex and amygdala collaborate in outcome-guided decision-making through reciprocal projections. While serotonin transporter knockout (SERT-/-) rodents show changes in outcome-guided decision-making, and in orbitofrontal cortex and amygdala neuronal activity, it remains unclear whether SERT genotype modulates orbitofrontal cortex-amygdala synchronization. We trained SERT-/- and SERT+/+ male rats to execute a task requiring to discriminate between two auditory stimuli, one predictive of a reward (CS+) and the other not (CS-), by responding through nose pokes in opposite-side ports. Overall, task acquisition was not influenced by genotype. Next, we simultaneously recorded local field potentials in the orbitofrontal cortex and amygdala of both hemispheres while the rats performed the task. Behaviorally, SERT-/- rats showed a nonsignificant trend for more accurate responses to the CS-. Electrophysiologically, orbitofrontal cortex-amygdala synchronization in the beta and gamma frequency bands during response selection was significantly reduced and associated with decreased hubness and clustering coefficient in both regions in SERT-/- rats compared to SERT+/+ rats. Conversely, theta synchronization at the time of behavioral response in the port associated with reward was similar in both genotypes. Together, our findings reveal the modulation by SERT genotype of the orbitofrontal cortex-amygdala functional connectivity during an auditory discrimination task.

Pathways to adolescent social anxiety: Testing interactions between neural social reward function and perceived social threat in daily life

Recent theories suggest that for youth highly sensitive to incentives, perceiving more social threat may contribute to social anxiety (SA) symptoms. In 129 girls (ages 11-13) oversampled for shy/fearful temperament, we thus examined how interactions between neural responses to social reward (vs. neutral) cues (measured during anticipation of peer feedback) and perceived social threat in daily peer interactions (measured using ecological momentary assessment) predict SA symptoms two years later. No significant interactions emerged when neural reward function was modeled as a latent factor. Secondary analyses showed that higher perceived social threat was associated with more severe SA symptoms two years later only for girls with higher basolateral amygdala (BLA) activation to social reward cues at baseline. Interaction effects were specific to BLA activation to social reward (not threat) cues, though a main effect of BLA activation to social threat (vs. neutral) cues on SA emerged. Unexpectedly, interactions between social threat and BLA activation to social reward cues also predicted generalized anxiety and depression symptoms two years later, suggesting possible transdiagnostic risk pathways. Perceiving high social threat may be particularly detrimental for youth highly sensitive to reward incentives, potentially due to mediating reward learning processes, though this remains to be tested.

Encoding of Predictive Associations in Human Prefrontal and Medial Temporal Neurons During Pavlovian Appetitive Conditioning

Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here, we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus, and amygdala while patients of both sexes performed an appetitive Pavlovian conditioning task probing both stimulus-value and stimulus-stimulus associations. Ventromedial prefrontal cortex encoded predictive value along with the amygdala, and also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial frontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.

Neither Amphetamine nor Sub-Anesthetic Ketamine Treatment during Adolescence Impairs Devaluation in Rats Tested during Adulthood

BACKGROUND

Much of the existing animal literature on the devaluation task suggests that prior repeated exposure to drugs of abuse during adulthood can impair goal-directed action, but the literature on human drug users is mixed. Also, the initiation of drug use often occurs during adolescence, but examinations of the effects of drug exposure during adolescence on behavior in the devaluation task are lacking.

METHODS

We examined whether repeated exposure during adolescence to amphetamine (3 mg/kg injections every-other day from post-natal day 27-45) or ketamine (twice daily 30 mg/kg injections from post-natal day 35-44) would impair behavior in a devaluation test when tested drug-free in adulthood. Rats were trained to press a left lever with a steady cue-light above it for one reinforcer and a right lever with a flashing cue-light above it for a different reinforcer. We tested whether any impairments in goal-directed action could be overcome by compensation between strategies by giving rats information based on lever-location and cue-lights during the test that was either congruent (allowing compensation) or incongruent (preventing compensation between strategies) with the configurations during training.

RESULTS

Our results provided no evidence for impairment of goal-directed action during adulthood after adolescent amphetamine or ketamine exposure.

CONCLUSIONS

We discuss possible reasons for this discrepancy with the prior literature, including (1) the age of exposure and (2) the pattern in the previous literature that most previous demonstrations of drug exposure impairing devaluation in laboratory animals may be attributed to either drug-associated cues present in the testing environment and/or accelerated habit learning in tasks that predispose laboratory animals towards habit formation with extended training (with training procedures that should resist the formation of habits in the current experiment). However, additional research is needed to examine the effects of these factors, as well a potential role for the particular doses and washout periods to determine the cause of our finding of no devaluation impairment after drug exposure.

The effect of emotional faces on reward-related probability learning in depressed patients

BACKGROUND

Existing research indicates that individuals with Major Depressive Disorder (MDD) exhibit a bias toward salient negative stimuli. However, the impact of such biased stimuli on concurrent cognitive and affective processes in individuals with depression remains inadequately understood. This study aimed to investigate the effects of salient environmental stimuli, specifically emotional faces, on reward-associated processes in MDD.

METHODS

Thirty-three patients with recurrent MDD and thirty-two healthy controls (HC) matched for age, sex, and education were included in the study. We used a reward-related associative learning (RRAL) task primed with emotional (happy, sad, neutral) faces to investigate the effect of salient stimuli on reward-related learning and decision-making in functional magnetic resonance imaging (fMRI). Participants were instructed to ignore emotional faces during the task. The fMRI data were analyzed using a full-factorial general linear model (GLM) in Statistical Parametric Mapping (SPM12).

RESULTS

In depressed patients, cues primed with sad faces were associated with reduced amygdala activation. However, both HC and MDD group exhibited reduced ventral striatal activity while learning reward-related cues and receiving rewards.

LIMITATIONS

The patients'medication usage was not standardized.

CONCLUSIONS

This study underscores the functional alteration of the amygdala in response to cognitive tasks presented with negative emotionally salient stimuli in the environment of MDD patients. The observed alterations in amygdala activity suggest potential interconnected effects with other regions of the prefrontal cortex. Understanding the intricate neural connections and their disruptions in depression is crucial for unraveling the complex pathophysiology of the disorder.

Altered neuronal response to visual food stimuli in adolescents undergoing chronic sleep restriction

STUDY OBJECTIVES

Poor sleep in adolescents can increase the risk of obesity, possibly due to changes in dietary patterns. Prior neuroimaging evidence, mostly in adults, suggests that lacking sleep results in increased response to food cues in reward-processing brain regions. Needed is a clarification of the mechanisms by which food reward processing is altered by the kind of chronic sleep restriction (SR) typically experienced by adolescents. This study aimed to elucidate the impact of sleep duration on response to visual food stimuli in healthy adolescents using functional neuroimaging, hypothesizing increased reward processing response after SR compared to a well-rested condition.

METHODS

Thirty-nine healthy adolescents, 14-17 years old, completed a 3-week protocol: (1) sleep phase stabilization; (2) SR (~6.5 h nightly); and (3) healthy sleep (HS) duration (~9 h nightly). Participants underwent functional MRI while performing a visual food paradigm. Contrasts of food versus nonfood responses were compared within-subject between conditions of SR and HS.

RESULTS

Under SR, there was a greater response to food stimuli compared to HS in a voxel cluster including the left ventral tegmental area and substantia nigra. No change in food appeal rating due to the sleep manipulation was detected.

CONCLUSIONS

Outcomes of this study suggest that SR, as commonly experienced by healthy adolescents, results in the elevated dopaminergic drive of the reward network that may augment motivation to seek food in the context of individual food appeal and inhibitory profiles. Countermeasures that reduce food salience could include promoting consistent HS habits.

Dopamine projections to the basolateral amygdala drive the encoding of identity-specific reward memories

To make adaptive decisions, we build an internal model of the associative relationships in an environment and use it to make predictions and inferences about specific available outcomes. Detailed, identity-specific cue-reward memories are a core feature of such cognitive maps. Here we used fiber photometry, cell-type and pathway-specific optogenetic manipulation, Pavlovian cue-reward conditioning and decision-making tests in male and female rats, to reveal that ventral tegmental area dopamine (VTADA) projections to the basolateral amygdala (BLA) drive the encoding of identity-specific cue-reward memories. Dopamine is released in the BLA during cue-reward pairing; VTADA→BLA activity is necessary and sufficient to link the identifying features of a reward to a predictive cue but does not assign general incentive properties to the cue or mediate reinforcement. These data reveal a dopaminergic pathway for the learning that supports adaptive decision-making and help explain how VTADA neurons achieve their emerging multifaceted role in learning.

Facing emotions: real-time fMRI-based neurofeedback using dynamic emotional faces to modulate amygdala activity

Introduction

Maladaptive functioning of the amygdala has been associated with impaired emotion regulation in affective disorders. Recent advances in real-time fMRI neurofeedback have successfully demonstrated the modulation of amygdala activity in healthy and psychiatric populations. In contrast to an abstract feedback representation applied in standard neurofeedback designs, we proposed a novel neurofeedback paradigm using naturalistic stimuli like human emotional faces as the feedback display where change in the facial expression intensity (from neutral to happy or from fearful to neutral) was coupled with the participant's ongoing bilateral amygdala activity.

Methods

The feasibility of this experimental approach was tested on 64 healthy participants who completed a single training session with four neurofeedback runs. Participants were assigned to one of the four experimental groups (n = 16 per group), i.e., happy-up, happy-down, fear-up, fear-down. Depending on the group assignment, they were either instructed to "try to make the face happier" by upregulating (happy-up) or downregulating (happy-down) the amygdala or to "try to make the face less fearful" by upregulating (fear-up) or downregulating (fear-down) the amygdala feedback signal.

Results

Linear mixed effect analyses revealed significant amygdala activity changes in the fear condition, specifically in the fear-down group with significant amygdala downregulation in the last two neurofeedback runs as compared to the first run. The happy-up and happy-down groups did not show significant amygdala activity changes over four runs. We did not observe significant improvement in the questionnaire scores and subsequent behavior. Furthermore, task-dependent effective connectivity changes between the amygdala, fusiform face area (FFA), and the medial orbitofrontal cortex (mOFC) were examined using dynamic causal modeling. The effective connectivity between FFA and the amygdala was significantly increased in the happy-up group (facilitatory effect) and decreased in the fear-down group. Notably, the amygdala was downregulated through an inhibitory mechanism mediated by mOFC during the first training run.

Discussion

In this feasibility study, we intended to address key neurofeedback processes like naturalistic facial stimuli, participant engagement in the task, bidirectional regulation, task congruence, and their influence on learning success. It demonstrated that such a versatile emotional face feedback paradigm can be tailored to target biased emotion processing in affective disorders.

Dissociable Contributions of Basolateral Amygdala and Ventrolateral Orbitofrontal Cortex to Flexible Learning Under Uncertainty

Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including the highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, the unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory designer receptors exclusively activated by designer drugs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-/post-reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of the ventrolateral orbitofrontal cortex (vlOFC), but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.

A hippocampo-cortical pathway detects changes in the validity of an action as a predictor of reward

Much research has been dedicated to understanding the psychological and neural bases of goal-directed action, yet the relationship between context and goal-directed action is not well understood. Here, we used excitotoxic lesions, chemogenetics, and circuit-specific manipulations to demonstrate the role of the ventral hippocampus (vHPC) in contextual learning that supports sensitivity to action-outcome contingencies, a hallmark of goal-directed action. We found that chemogenetic inhibition of the ventral, but not dorsal, hippocampus attenuated sensitivity to instrumental contingency degradation. We then tested the hypothesis that this deficit was due to an inability to discern the relative validity of the action compared with the context as a predictor of reward. Using latent inhibition and Pavlovian context conditioning, we confirm that degradation of action-outcome contingencies relies on intact context-outcome learning and show that this learning is dependent on vHPC. Finally, we show that chemogenetic inhibition of vHPC terminals in the medial prefrontal cortex also impairs both instrumental contingency degradation and context-outcome learning. These results implicate a hippocampo-cortical pathway in adapting to changes in instrumental contingencies and indicate that the psychological basis of this deficit is an inability to learn the predictive value of the context. Our findings contribute to a broader understanding of the neural bases of goal-directed action and its contextual regulation.

Altered connectivity patterns of medial and lateral orbitofrontal cortex underlie the severity of bulimic symptoms

Objective

Compared to clinical bulimia nervosa, sub-threshold bulimic symptoms are becoming more prevalent in non-clinical or general population, which is repeatedly linked with the connectivity in orbitofrontal cortex (OFC), including functionally heterogeneous the medial and lateral OFC (mOFC; lOFC). However, the specific connectivity patterns of the mOFC and lOFC in individuals with severe or mild bulimic symptoms (SB; MB) remain poorly understood.

Methods

We first utilized resting-state functional connectivity (FC) and spectral dynamic causal modeling (spDCM) to investigate abnormal functional and effective connectivity (EC) of OFC subregions in adults with different severity of bulimic. The SB group (n = 21), MB group (n = 114), and healthy controls (HC, n = 91) underwent rs-fMRI scans. A generalized linear model was applied to determine the OFC-seeded whole-brain FC across the three groups. Subsequently, spDCM was used to estimate differences in EC among the three groups based on the FC results.

Results

We observed a shared neural basis for SB and MB groups (i.e., weaker lOFC-superior parietal lobule connectivity), which may support the role of dysfunctional inhibitory control in general bulimic symptomatology. Whereas, SB group displayed greater lOFC-occipital pole connectivity than MB group, suggesting the specificity of the neural correlates of full-threshold/severe bulimia. The directional links from the mOFC to lOFC and amygdala could further explain the aberrant interactions of reward sensitivity with inhibitory control and homeostatic energy in sub-threshold/mild condition.

Conclusion

The current study provides novel evidence that divergent connectivity patterns of the lOFC and mOFC may contribute to different severities of bulimia, which will expands our understanding of the neurobiological substrates underlying bulimia across a spectrum from healthy to unhealthy.

Multiple Memory Subsystems: Reconsidering Memory in the Mind and Brain

The multiple-memory-systems framework-that distinct types of memory are supported by distinct brain systems-has guided learning and memory research for decades. However, recent work challenges the one-to-one mapping between brain structures and memory types central to this taxonomy, with key memory-related structures supporting multiple functions across substructures. Here we integrate cross-species findings in the hippocampus, striatum, and amygdala to propose an updated framework of multiple memory subsystems (MMSS). We provide evidence for two organizational principles of the MMSS theory: First, opposing memory representations are colocated in the same brain structures; second, parallel memory representations are supported by distinct structures. We discuss why this burgeoning framework has the potential to provide a useful revision of classic theories of long-term memory, what evidence is needed to further validate the framework, and how this novel perspective on memory organization may guide future research.

Short- and Long-Term High-Fat Diet Exposure Differentially Alters Phasic and Tonic GABAergic Signaling onto Lateral Orbitofrontal Pyramidal Neurons

The chronic consumption of caloric dense high-fat foods is a major contributor to increased body weight, obesity, and other chronic health conditions. The orbitofrontal cortex (OFC) is critical in guiding decisions about food intake and is altered with diet-induced obesity. Obese rodents have altered morphologic and synaptic electrophysiological properties in the lateral orbitofrontal cortex (lOFC). Yet the time course by which exposure to a high-fat diet (HFD) induces these changes is poorly understood. Here, male mice are exposed to either short-term (7 d) or long-term (90 d) HFD. Long-term HFD exposure increases body weight, and glucose signaling compared with short-term HFD or a standard control diet (SCD). Both short and long-term HFD exposure increased the excitability of lOFC pyramidal neurons. However, phasic and tonic GABAergic signaling was differentially altered depending on HFD exposure length, such that tonic GABAergic signaling was decreased with early exposure to the HFD and phasic signaling was changed with long-term diet exposure. Furthermore, alterations in the short-term diet exposure were transient, as removal of the diet restored electrophysiological characteristics similar to mice fed SCD, whereas long-term HFD electrophysiological changes were persistent and remained after HFD removal. Finally, we demonstrate that changes in reward devaluation occur early with diet exposure. Together, these results suggest that the duration of HFD exposure differentially alters lOFC function and provides mechanistic insights into the susceptibility of the OFC to impairments in outcome devaluation.SIGNIFICANCE STATEMENT This study provides mechanistic insight on the impact of short-term and long-term high-fat diet (HFD) exposure on GABAergic function in the lateral orbitofrontal cortex (lOFC), a region known to guide decision-making. We find short-term HFD exposure induces transient changes in firing and tonic GABA action on lOFC pyramidal neurons, whereas long-term HFD induces obesity and has lasting changes on firing, tonic GABA and inhibitory synaptic transmission onto lOFC neurons. Given that GABAergic signaling in the lOFC can influence decision-making around food, these results have important implications in present society as palatable energy dense foods are abundantly available.

Dissociable contributions of basolateral amygdala and ventrolateral orbitofrontal cortex to flexible learning under uncertainty

Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach and particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory DREADDs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-post reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of vlOFC, but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.

Dopamine in the dorsal bed nucleus of stria terminalis signals Pavlovian sign-tracking and reward violations

Midbrain and striatal dopamine signals have been extremely well characterized over the past several decades, yet novel dopamine signals and functions in reward learning and motivation continue to emerge. A similar characterization of real-time sub-second dopamine signals in areas outside of the striatum has been limited. Recent advances in fluorescent sensor technology and fiber photometry permit the measurement of dopamine binding correlates, which can divulge basic functions of dopamine signaling in non-striatal dopamine terminal regions, like the dorsal bed nucleus of the stria terminalis (dBNST). Here, we record GRABDA signals in the dBNST during a Pavlovian lever autoshaping task. We observe greater Pavlovian cue-evoked dBNST GRABDA signals in sign-tracking (ST) compared to goal-tracking/intermediate (GT/INT) rats and the magnitude of cue-evoked dBNST GRABDA signals decreases immediately following reinforcer-specific satiety. When we deliver unexpected rewards or omit expected rewards, we find that dBNST dopamine signals encode bidirectional reward prediction errors in GT/INT rats, but only positive prediction errors in ST rats. Since sign- and goal-tracking approach strategies are associated with distinct drug relapse vulnerabilities, we examined the effects of experimenter-administered fentanyl on dBNST dopamine associative encoding. Systemic fentanyl injections do not disrupt cue discrimination but generally potentiate dBNST dopamine signals. These results reveal multiple dBNST dopamine correlates of learning and motivation that depend on the Pavlovian approach strategy employed.

INVOLVEMENT OF CORTICAL PROJECTIONS TO BASOLATERAL AMYGDALA IN CONTEXT-INDUCED REINSTATEMENT OF ETHANOL-SEEKING IN RATS

Ethanol is the most consumed substance of abuse in the world, and its misuse may lead to the development of alcohol use disorder (AUD). High relapse rates remain a relevant problem in the treatment of AUD. Exposure to environmental cues previously associated with ethanol intake could trigger ethanol-seeking behavior. However, the neural mechanisms involved in this phenomenon are not entirely clear. In this context, cortical projections to the basolateral amygdala (BLA) play a role in appetitive and aversive learned behaviors. Therefore, we aimed to evaluate the activation of the cortical projections from the prelimbic (PL), orbitofrontal (OFC), and infralimbic (IL), to the BLA in the context-induced reinstatement of ethanol-seeking. Male Long-Evans rats were trained to self-administer 10% ethanol in Context A. Subsequently, lever pressing in the presence of the discrete cue was extinguished in Context B. After nine extinction sessions, rats underwent intracranial surgery for the unilateral injection of red fluorescent retrograde tracer into the BLA. The context-induced reinstatement of ethanol-seeking was assessed by re-exposing the rats to Context A or B under extinction conditions. Finally, we combined retrograde neuronal tracing with Fos to identify activated cortical inputs to BLA during the reinstatement of ethanol-seeking behavior. We found that PL, but not OFC or IL, retrogradely-labeled neurons from BLA presented increased Fos expression during the re-exposure to the ethanol-associated context, suggesting that PL projection to BLA is involved in the context-induced reinstatement of ethanol-seeking behavior.

Regulation of dendritic spines in the amygdala following sleep deprivation

The amygdala is a hub of emotional circuits involved in the regulation of cognitive and emotional behaviors and its critically involved in emotional reactivity, stress regulation, and fear memory. Growing evidence suggests that the amygdala plays a key role in the consolidation of emotional memories during sleep. Neuroimaging studies demonstrated that the amygdala is selectively and highly activated during rapid eye movement sleep (REM) and sleep deprivation induces emotional instability and dysregulation of the emotional learning process. Regulation of dendritic spines during sleep represents a morphological correlate of memory consolidation. Several studies indicate that dendritic spines are remodeled during sleep, with evidence for broad synaptic downscaling and selective synaptic upscaling in several cortical areas and the hippocampus. Currently, there is a lack of information regarding the regulation of dendritic spines in the amygdala during sleep. In the present work, we investigated the effect of 5 h of sleep deprivation on dendritic spines in the mouse amygdala. Our data demonstrate that sleep deprivation results in differential dendritic spine changes depending on both the amygdala subregions and the morphological subtypes of dendritic spines. We observed decreased density of mushroom spines in the basolateral amygdala of sleep deprived mice, together with increased neck length and decreased surface area and volume. In contrast, we observed greater densities of stubby spines in sleep deprived mice in the central amygdala, indicating that downscaling selectively occurs in this spine type. Greater neck diameters for thin spines in the lateral and basolateral nuclei of sleep deprived mice, and decreases in surface area and volume for mushroom spines in the basolateral amygdala compared to increases in the cental amygdala provide further support for spine type-selective synaptic downscaling in these areas during sleep. Our findings suggest that sleep promotes synaptic upscaling of mushroom spines in the basolateral amygdala, and downscaling of selective spine types in the lateral and central amygdala. In addition, we observed decreased density of phosphorylated cofilin immunoreactive and growth hormone immunoreactive cells in the amygdala of sleep deprived mice, providing further support for upscaling of dendritic spines during sleep. Overall, our findings point to region-and spine type-specific changes in dendritic spines during sleep in the amygdala, which may contribute to consolidation of emotional memories during sleep.

Learning About Reward Identities and Time

We discuss three empirical findings that we think any theory attempting to integrate interval timing with associative learning concepts will need to address. These empirical phenomena all come from studies that combine peak timing procedures with reinforcer devaluation or conditional discrimination tasks commonly employed, respectively, in interval timing or associative learning research traditions. The three phenomena we discuss include: (1) the observation that disruptions in reward identity encoding have little to no impact on the encoding of reward time in the a peak procedure (Delamater., 1998), (2) the findings that organisms tend to average their time estimates when presented with a stimulus compound consisting of separately learned stimuli indicating short or long reward times but that such temporal averaging, itself, is sensitive to post-conditioning selective reward devaluation, and (3) that rats can learn a temporal patterning task in which two stimuli presented independently indicate one time to reward availability while their compound indicates another. We review our prior results and present new findings illustrating these three phenomena and we discuss the special challenges they pose for cascade theories of timing, for multiple-oscillator models, and for any approach that attempts to integrate interval timing and associative models. We close by illustrating some ways in which multi-layer connectionist network models might begin to address some of our key findings. We believe this will require an approach that includes separate mechanisms that code for reward identity and time, but that does so in a way that permits for integration between the two systems.

Medial orbitofrontal cortical regulation of different aspects of Pavlovian and instrumental reward seeking

RATIONALE

The medial subregion of the orbitofrontal cortex (mOFC) is thought to play an important role representing the expected outcome of a given course of action, as lesioning or inactivating this cortical region results in the adoption of choice strategies based more on observable (rather than previously learned) information. Despite this, its role in mediating basic associative learning remains to be fully clarified.

OBJECTIVE

The present series of experiments examined the role of the mOFC in (1) Pavlovian conditioned approach, (2) conditioned reinforcement, (3) extinction, and (4) cue-induced reinstatement of food-seeking behavior.

METHODS

Separate cohorts of rats went through Pavlovian or instrumental training. Intra-mOFC infusions of either saline or GABA agonists (to temporarily inactivate neural activity) were given prior to Pavlovian approach, conditioned reinforcement, first or second day of instrumental extinction training, or cue-induced reinstatement test days.

RESULTS

mOFC inactivation increased lever-CS contacts in Pavlovian conditioned approach and (2) had no effect on conditioned reinforcement. These manipulations (3) accelerated within-session instrumental extinction during the initial extinction session, but impaired subsequent extinction learning on drug-free days. (4) mOFC inactivation induced differential effects on reinstatement that depended on baseline performance. mOFC inactivation abolished reinstatement in "Reinstater" rats (who displayed robust responding under control conditions) and robustly increased reinstatement in "Non-Reinstater" rats (who showed little reinstatement under control conditions) suggesting that individual differences in reinstatement may be supported by differences in mOFC mediated representations of expected outcomes.

CONCLUSIONS

These findings have important implications for understanding how the mOFC uses stimulus-outcome and action-outcome expectancies to guide behavior, and how dysfunction within this region may contribute to pathological patterns of reward seeking.

Basolateral amygdala and orbitofrontal cortex, but not dorsal hippocampus, are necessary for the control of reward-seeking by occasion setters

Reward-seeking in the world is driven by cues that can have ambiguous predictive and motivational value. To produce adaptive, flexible reward-seeking, it is necessary to exploit occasion setters, other distinct features in the environment, to resolve the ambiguity of Pavlovian reward-paired cues. Despite this, very little research has investigated the neurobiological underpinnings of occasion setting, and as a result little is known about which brain regions are critical for occasion setting. To address this, we exploited a recently developed task that was amenable to neurobiological inquiry where a conditioned stimulus is only predictive of reward delivery if preceded in time by the non-overlapping presentation of a separate cue-an occasion setter. This task required male rats to maintain and link cue-triggered expectations across time to produce adaptive reward-seeking. We interrogated the contributions of the basolateral amygdala and orbitofrontal cortex to occasion setting as these regions are thought to be critical for the computation and exploitation of state value, respectively. Reversible inactivation of either structure prior to the occasion-setting task resulted in a profound inability of rats to use the occasion setter to guide reward-seeking. In contrast, inactivation of the dorsal hippocampus, a region fundamental for context-specific responding was without effect nor did inactivation of the basolateral amygdala or orbitofrontal cortex in a standard Pavlovian conditioning preparation affect conditioned responding. We conclude that neural activity within the orbitofrontal cortex and basolateral amygdala circuit is necessary to update and resolve ambiguity in the environment to promote cue-driven reward-seeking.

Optogenetic activation of basolateral amygdala-to-nucleus accumbens core neurons promotes Pavlovian approach responses but not instrumental pursuit of reward cues

Reward-associated conditioned stimuli (CSs) can acquire predictive value, evoking conditioned approach behaviours that prepare animals to engage with forthcoming rewards. Such CSs can also acquire conditioned reinforcing value, becoming attractive and pursued. Through their conditioned effects, CSs can promote adaptive (e.g., locating food) but also maladaptive behaviours (e.g., drug use). Basolateral amygdala neurons projecting to the nucleus accumbens core (BLA→NAc core neurons) mediate the response to appetitive CSs, but the extent to which this involves effects on the predictive and/or conditioned reinforcing properties of CSs is unclear. Thus, we examined the effects of optogenetic stimulation of BLA→NAc core neurons on i) CS-triggered approach to the site of reward delivery, a Pavlovian conditioned approach response and ii) the instrumental pursuit of a CS, a measure of conditioned reinforcement. Water-restricted, adult male rats learned that a light-tone compound cue (the CS) predicts water delivery into a receptacle. Pairing optogenetic stimulation of BLA→NAc core neurons with CS presentation potentiated CS-triggered water receptacle visits. This suggests that activity in BLA→NAc core neurons promotes Pavlovian goal-approach behaviour. Next, rats could lever press for CS presentations, without water delivery. Optogenetic stimulation of BLA→NAc core neurons either during instrumental test sessions or during prior CS-water conditioning did not influence lever responding for the CS. This suggests that activity in BLA→NAc core neurons does not influence the instrumental pursuit of a water-paired CS. We conclude that activation of BLA→NAc core neurons promotes cue-induced control over behaviour by increasing conditioned goal-approach responses, without affecting the operant pursuit of reward cues.

Disinhibition of the orbitofrontal cortex biases decision-making in obesity

The lateral orbitofrontal cortex (lOFC) receives sensory information about food and integrates these signals with expected outcomes to guide future actions, and thus may play a key role in a distributed network of neural circuits that regulate feeding behavior. Here, we reveal a new role for the lOFC in the cognitive control of behavior in obesity. Food-seeking behavior is biased in obesity such that in male obese mice, behaviors are less flexible to changes in the perceived value of the outcome. Obesity is associated with reduced lOFC inhibitory drive and chemogenetic reduction in GABAergic neurotransmission in the lOFC induces obesity-like impairments in goal-directed behavior. Conversely, pharmacological or optogenetic restoration of inhibitory neurotransmission in the lOFC of obese mice reinstates flexible behavior. Our results indicate that obesity-induced disinhibition of the lOFC leads to a failure to update changes in the value of food with satiety, which in turn may influence how individuals make decisions in an obesogenic environment.

Trial-by-trial fluctuations in amygdala activity track motivational enhancement of desirable sensory evidence during perceptual decision-making

People are biased toward seeing outcomes that they are motivated to see. For example, wanting their favored team to prevail biases sports fans to perceive an ambiguous foul in a manner that is favorable to the team they support. Here, we test the hypothesis that such motivational biases in perceptual decision-making are associated with amygdala activity. We used monetary incentives to experimentally manipulate participants to want to see one percept over another while they performed a categorization task involving ambiguous images. Participants were more likely to categorize an image as the category we motivated them to see, suggesting that wanting to see a particular percept biased their perceptual decisions. Heightened amygdala activity was associated with motivation consistent categorizations and tracked trial-by-trial enhancement of neural activity in sensory cortices encoding the desirable category. Analyses using a drift diffusion model further suggest that trial-by-trial amygdala activity was specifically associated with biases in the accumulation of sensory evidence. In contrast, frontoparietal regions commonly associated with biases in perceptual decision-making were not associated with motivational bias. Altogether, our results suggest that wanting to see an outcome biases perceptual decisions via distinct mechanisms and may depend on dynamic fluctuations in amygdala activity.

Outcome devaluation by specific satiety disrupts sensory-specific Pavlovian-to-instrumental transfer

Reward predictive cues can selectively motivate instrumental behaviors that predict the same rewarding outcomes, an effect known as specific Pavlovian-to-instrumental transfer (PIT). This selective effect is thought to be mediated by a representation of the sensory specific properties of an outcome, that has become associated with both the Pavlovian cue and the instrumental response during initial learning. Specific satiety is a common method of outcome devaluation that reduces an outcome's value but might also lead to the habituation of the outcome's sensory properties. Previous research has demonstrated that specific PIT is insensitive to changes in specific outcome value following taste aversion devaluation, as well as general satiety manipulations, and therefore specific satiety should not disrupt specific PIT by reducing outcome value. The present rodent experiments used a specific satiety devaluation procedure immediately prior to a specific PIT test to show that habituation of these outcome specific sensory representations can disrupt its efficacy as a stimulus and abolish the specific PIT effect. Experiment 1 employed a two-lever choice test to show that a non-devalued stimulus supports specific PIT, whereas a devalued stimulus abolished the specific PIT effect. Experiment 2 replicated this procedure while controlling for response competition by using a single-lever test to confirm that a devalued stimulus abolishes the specific PIT effect. These findings demonstrate that specific satiety can disrupt the ability of an outcome specific representation to support specific PIT. Given previous findings that specific PIT is insensitive to changes in outcome value by general satiety and taste aversion devaluation, this suggests that specific satiety devaluation might disrupt the use of sensory specific outcome representations to guide behavior via a mechanism that is independent of the outcome's current value.

Prelimbic cortex neural encoding dynamically tracks expected outcome value

Animals must modify their behavior based on updated expected outcomes in a changing environment. Prelimbic cortex (PrL) neural encoding during learning predicts, and is necessary for, appropriately altering behavior based on a new expected outcome value following devaluation. We aimed to determine how PrL neural activity encodes reward predictive cues after the expected outcome value of those cues is decreased following conditioned taste aversion. In one post-devaluation session, rats were tested under extinction to determine their ability to alter their behavior to the expected outcome values (i.e., extinction test). In a second post-devaluation session, rats were tested with the newly devalued outcome delivered so that the rats experienced the updated outcome value within the session (i.e., re-exposure test). We found that PrL neural encoding of the cue associated with the devalued reward predicted the ability of rats to suppress behavior in the extinction test session, but not in the re-exposure test session. While all rats were able to successfully devalue the outcome during conditioned taste aversion, a subset of rats continued to consume the devalued outcome in the re-exposure test session. We found differential patterns of PrL neural encoding in the population of rats that did not avoid the devalued outcome during the re-exposure test compared to the rats that successfully avoided the devalued outcome. Our findings suggest that PrL neural encoding dynamically tracks expected outcome values, and differential neural encoding in the PrL to reward predictive cues following expected outcome value changes may contribute to distinct behavioral phenotypes.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

Inactivation of the Basolateral Amygdala to Insular Cortex Pathway Makes Sign-Tracking Sensitive to Outcome Devaluation

Goal-tracking (GT) rats are sensitive to Pavlovian outcome devaluation while sign-tracking (ST) rats are devaluation insensitive. During outcome devaluation, GT rats flexibly modify responding to cues based on the current value of the associated outcome. However, ST rats rigidly respond to cues regardless of the current outcome value. Prior work demonstrated disconnection of the basolateral amygdala (BLA) and anterior insular cortex (aIC) decreased both GT and ST behaviors. Given the role of these regions in appetitive motivation and behavioral flexibility, we predicted that disrupting BLA to aIC pathway during outcome devaluation would reduce flexibility in GT rats and reduce rigid appetitive motivation in ST rats. We inhibited the BLA to aIC pathway by infusing inhibitory DREADDs (hM4Di-mcherry) or control (mCherry) virus into the BLA and implanted cannulae into the aIC to inhibit BLA terminals using intracranial injections of clozapine N-oxide (CNO). After training, we used a within-subject satiety-induced outcome devaluation procedure in which we sated rats on training pellets (devalued condition) or homecage chow (valued condition). All rats received bilateral CNO infusions into the aIC before brief nonreinforced test sessions. Contrary to our hypothesis, BLA-IC inhibition did not interfere with devaluation sensitivity in GT rats but did make ST behaviors sensitive to devaluation. Intermediate rats showed the opposite effect, showing rigid responding to cues with BLA-aIC pathway inactivation. Together, these results demonstrate BLA-IC projections mediate tracking-specific Pavlovian devaluation sensitivity and highlights the importance of considering individual differences in Pavlovian approach when evaluating circuitry contributions to behavioral flexibility.

Social incentivization of instrumental choice in mice requires amygdala-prelimbic cortex-nucleus accumbens connectivity

Social experiences influence decision making, including decision making lacking explicit social content, yet mechanistic factors are unclear. We developed a new procedure, social incentivization of future choice (SIFC). Female mice are trained to nose poke for equally-preferred foods, then one food is paired with a novel conspecific, and the other with a novel object. Mice later respond more for the conspecific-associated food. Thus, prior social experience incentivizes later instrumental choice. SIFC is pervasive, occurring following multiple types of social experiences, and is not attributable to warmth or olfactory cues alone. SIFC requires the prelimbic prefrontal cortex (PL), but not the neighboring orbitofrontal cortex. Further, inputs from the basolateral amygdala to the PL and outputs to the nucleus accumbens are necessary for SIFC, but not memory for a conspecific. Basolateral amygdala→PL connections may signal the salience of social information, leading to the prioritization of coincident rewards via PL→nucleus accumbens outputs.

Food cue reactivity: Neurobiological and behavioral underpinnings

The modern obesogenic environment contains an abundance of food cues (e.g., sight, smell of food) as well cues that are associated with food through learning and memory processes. Food cue exposure can lead to food seeking and excessive consumption in otherwise food-sated individuals, and a high level of food cue responsivity is a risk factor for overweight and obesity. Similar food cue responses are observed in experimental rodent models, and these models are therefore useful for mechanistically identifying the neural circuits mediating food cue responsivity. This review draws from both experimental rodent models and human data to characterize the behavioral and biological processes through which food-associated stimuli contribute to overeating and weight gain. Two rodent models are emphasized - cue-potentiated feeding and Pavlovian-instrumental transfer - that provide insight in the neural circuits and peptide systems underlying food cue responsivity. Data from humans are highlighted that reveal physiological, psychological, and neural mechanisms that connect food cue responsivity with overeating and weight gain. The collective literature identifies connections between heightened food cue responsivity and obesity in both rodents and humans, and identifies underlying brain regions (nucleus accumbens, amygdala, orbitofrontal cortex, hippocampus) and endocrine systems (ghrelin) that regulate food cue responsivity in both species. These species similarities are encouraging for the possibility of mechanistic rodent model research and further human research leading to novel treatments for excessive food cue responsivity in humans.

Selective Prefrontal-Amygdala Circuit Interactions Underlie Social and Nonsocial Valuation in Rhesus Macaques

Lesion studies in macaques suggest dissociable functions of the orbitofrontal cortex (OFC) and medial frontal cortex (MFC), with OFC being essential for goal-directed decision-making and MFC supporting social cognition. Bilateral amygdala damage results in impairments in both of these domains. There are extensive reciprocal connections between these prefrontal areas and the amygdala; however, it is not known whether the dissociable roles of OFC and MFC depend on functional interactions with the amygdala. To test this possibility, we compared the performance of male rhesus macaques (Macaca mulatta) with crossed surgical disconnection of the amygdala and either MFC (MFC × AMY, n = 4) or OFC (OFC × AMY, n = 4) to a group of unoperated controls (CON, n = 5). All monkeys were assessed for their performance on two tasks to measure the following: (1) food-retrieval latencies while viewing videos of social and nonsocial stimuli in a test of social interest and (2) object choices based on current food value using reinforcer devaluation in a test of goal-directed decision-making. Compared with the CON group, the MFC × AMY group, but not the OFC × AMY group, showed significantly reduced food-retrieval latencies while viewing videos of conspecifics, indicating reduced social valuation and/or interest. By contrast, on the devaluation task, group OFC × AMY, but not group MFC × AMY, displayed deficits on object choices following changes in food value. These data indicate that the MFC and OFC must functionally interact with the amygdala to support normative social and nonsocial valuation, respectively.SIGNIFICANCE STATEMENT Ascribing value to conspecifics (social) versus objects (nonsocial) may be supported by distinct but overlapping brain networks. Here, we test whether two nonoverlapping regions of the prefrontal cortex, the medial frontal cortex and the orbitofrontal cortex, must causally interact with the amygdala to sustain social valuation and goal-directed decision-making, respectively. We found that these prefrontal-amygdala circuits are functionally dissociable, lending support for the idea that medial frontal and orbital frontal cortex make independent contributions to cognitive appraisals of the environment. These data provide a neural framework for distinct value assignment processes and may enhance our understanding of the cognitive deficits observed following brain injury or in the development of mental health disorders.

Task-Dependent Effective Connectivity of the Reward Network During Food Cue-Reactivity: A Dynamic Causal Modeling Investigation

Neural reactivity to food cues may play a central role in overeating and excess weight gain. Functional magnetic resonance imaging (fMRI) studies have implicated regions of the reward network in dysfunctional food cue-reactivity, but neural interactions underlying observed patterns of signal change remain poorly understood. Fifty overweight and obese participants with self-reported cue-induced food craving viewed food and neutral cues during fMRI scanning. Regions of the reward network with significantly greater food versus neutral cue-reactivity were used to specify plausible models of task-related neural interactions underlying the observed blood oxygenation level-dependent (BOLD) signal, and a bi-hemispheric winning model was identified in a dynamic causal modeling (DCM) framework. Neuro-behavioral correlations are investigated with group factor analysis (GFA) and Pearson's correlation tests. The ventral tegmental area (VTA), amygdalae, and orbitofrontal cortices (OFC) showed significant food cue-reactivity. DCM suggests these activations are produced by largely reciprocal dynamic signaling between these regions, with food cues causing regional disinhibition and an apparent shifting of activity to the right amygdala. Intrinsic self-inhibition in the VTA and right amygdala is negatively correlated with measures of food craving and hunger and right-amygdalar disinhibition by food cues is associated with the intensity of cue-induced food craving, but no robust cross-unit latent factors were identified between the neural group and behavioral or demographic variable groups. Our results suggest a rich array of dynamic signals drive reward network cue-reactivity, with the amygdalae mediating much of the dynamic signaling between the VTA and OFCs. Neuro-behavioral correlations suggest particularly crucial roles for the VTA, right amygdala, and the right OFC-amygdala connection but the more robust GFA identified no cross-unit factors, so these correlations should be interpreted with caution. This investigation provides novel insights into dynamic circuit mechanisms with etiologic relevance to obesity, suggesting pathways in biomarker development and intervention.

Local modulation by presynaptic receptors controls neuronal communication and behaviour

Central nervous system neurons communicate via fast synaptic transmission mediated by ligand-gated ion channel (LGIC) receptors and slower neuromodulation mediated by G protein-coupled receptors (GPCRs). These receptors influence many neuronal functions, including presynaptic neurotransmitter release. Presynaptic LGIC and GPCR activation by locally released neurotransmitters influences neuronal communication in ways that modify effects of somatic action potentials. Although much is known about presynaptic receptors and their mechanisms of action, less is known about when and where these receptor actions alter release, especially in vivo. This Review focuses on emerging evidence for important local presynaptic receptor actions and ideas for future studies in this area.

The prediction-error hypothesis of schizophrenia: new data point to circuit-specific changes in dopamine activity

Schizophrenia is a severe psychiatric disorder affecting 21 million people worldwide. People with schizophrenia suffer from symptoms including psychosis and delusions, apathy, anhedonia, and cognitive deficits. Strikingly, schizophrenia is characterised by a learning paradox involving difficulties learning from rewarding events, whilst simultaneously 'overlearning' about irrelevant or neutral information. While dysfunction in dopaminergic signalling has long been linked to the pathophysiology of schizophrenia, a cohesive framework that accounts for this learning paradox remains elusive. Recently, there has been an explosion of new research investigating how dopamine contributes to reinforcement learning, which illustrates that midbrain dopamine contributes in complex ways to reinforcement learning, not previously envisioned. This new data brings new possibilities for how dopamine signalling contributes to the symptomatology of schizophrenia. Building on recent work, we present a new neural framework for how we might envision specific dopamine circuits contributing to this learning paradox in schizophrenia in the context of models of reinforcement learning. Further, we discuss avenues of preclinical research with the use of cutting-edge neuroscience techniques where aspects of this model may be tested. Ultimately, it is hoped that this review will spur to action more research utilising specific reinforcement learning paradigms in preclinical models of schizophrenia, to reconcile seemingly disparate symptomatology and develop more efficient therapeutics.

Distinct alterations of amygdala subregional functional connectivity in early- and late-onset obsessive-compulsive disorder

BACKGROUND

Age of onset may be an important feature associated with distinct subtypes of obsessive-compulsive disorder (OCD). The amygdala joined neurocircuitry models of OCD for its role in mediating fear and regulating anxiety. The present study aims to identify the underlying pathophysiological specifics in OCD with different onset times by assessing amygdala subregional functional connectivity (FC) alterations in early-onset OCD (EO-OCD) and late-onset OCD (LO-OCD).

METHODS

Resting-state functional magnetic resonance imaging data were acquired from 88 medication-free OCD patients (including 30 EO-OCD and 58 LO-OCD) and age- and sex-matched healthy controls (HC) for each patient group. Onset-by-diagnosis interactions were examined and comparisons between each OCD group and the corresponding HC group were performed regarding the FC of amygdala subregions including the basolateral amygdala (BLA), centromedial amygdala (CMA), superficial amygdala (SFA) and amygdalostriatal transition area (Astr).

RESULTS

Significant onset-by-diagnosis interactions were found in FC between bilateral SFA, right CMA, left Astr and the cerebellum. EO-OCD patients showed abnormally increased BLA/SFA-cerebellum, BLA-precuneus and BLA/SFA-fusiform connectivity in addition to decreased BLA/SFA-orbitofrontal cortex connectivity. In contrast, LO-OCD patients exhibited increased CMA/Astr-precentral/postcentral gyrus and CMA-cuneus connectivity as well as decreased CMA/Astr-cerebellum and BLA-striatum connectivity.

LIMITATIONS

The exclusion of comorbidity may reduce the generalizability of our results.

CONCLUSIONS

These findings emphasized the different patterns of amygdala subregional connectivity alterations associated with EO-OCD and LO-OCD patients. These results provide unique insights into constructing evidence-based distinct OCD subtypes based on brain intrinsic connectivity and point to the need of specified management for EO-OCD and LO-OCD in clinical setting.

Prefrontal cortex interactions with the amygdala in primates

This review addresses functional interactions between the primate prefrontal cortex (PFC) and the amygdala, with emphasis on their contributions to behavior and cognition. The interplay between these two telencephalic structures contributes to adaptive behavior and to the evolutionary success of all primate species. In our species, dysfunction in this circuitry creates vulnerabilities to psychopathologies. Here, we describe amygdala-PFC contributions to behaviors that have direct relevance to Darwinian fitness: learned approach and avoidance, foraging, predator defense, and social signaling, which have in common the need for flexibility and sensitivity to specific and rapidly changing contexts. Examples include the prediction of positive outcomes, such as food availability, food desirability, and various social rewards, or of negative outcomes, such as threats of harm from predators or conspecifics. To promote fitness optimally, these stimulus-outcome associations need to be rapidly updated when an associative contingency changes or when the value of a predicted outcome changes. We review evidence from nonhuman primates implicating the PFC, the amygdala, and their functional interactions in these processes, with links to experimental work and clinical findings in humans where possible.

Foraging with the frontal cortex: A cross-species evaluation of reward-guided behavior

Efficient foraging is essential to survival and depends on frontal cortex in mammals. Because of its role in psychiatric disorders, frontal cortex and its contributions to reward procurement have been studied extensively in both rodents and non-human primates. How frontal cortex of these animal models compares is a source of intense debate. Here we argue that translating findings from rodents to non-human primates requires an appreciation of both the niche in which each animal forages as well as the similarities in frontal cortex anatomy and function. Consequently, we highlight similarities and differences in behavior and anatomy, before focusing on points of convergence in how parts of frontal cortex contribute to distinct aspects of foraging in rats and macaques, more specifically. In doing so, our aim is to emphasize where translation of frontal cortex function between species is clearer, where there is divergence, and where future work should focus. We finish by highlighting aspects of foraging for which have received less attention but we believe are critical to uncovering how frontal cortex promotes survival in each species.

Deconstructing and reconstructing behaviour relevant to mental health disorders: The benefits of a psychological approach, with a focus on addiction

RUTHERFORD, L.G. and Milton, A.L. Deconstructing and reconstructing behaviour relevant to mental health disorders: what can psychology offer? NEUROSCI BIOBEHAV REV XX(X)XXX-XXX, 2021. - Current treatments for mental health disorders are successful only for some patients, and there is an unmet clinical need for new treatment development. One challenge for treatment development has been how best to model complex human conditions in animals, where mechanism can be more readily studied with a range of neuroscientific techniques. We suggest that an approach to modelling based on associative animal learning theory provides a good framework for deconstructing complex mental health disorders such that they can be studied in animals. These individual simple models can subsequently be used in combination to 'reconstruct' a more complex model of the mental health disorder of interest. Using examples primarily from the field of drug addiction, we explore the 'psychological approach' and suggest that in addition to facilitating translation and backtranslation of tasks between animal models and patients, it is also highly concordant with the concept of triangulation.

Serotonin 2C Antagonism in the Lateral Orbitofrontal Cortex Ameliorates Cue-Enhanced Risk Preference and Restores Sensitivity to Reinforcer Devaluation in Male Rats

Previous research has indicated that reward-paired cues can enhance disadvantageous risky choice in both humans and rodents. Systemic administration of a serotonin 2C receptor antagonist can attenuate this cue-induced risk preference in rats. However, the neurocognitive mechanisms mediating this effect are currently unknown. We therefore assessed whether the serotonin 2C receptor antagonist RS 102221 is able to attenuate cue-enhanced risk preference via its actions in the lateral orbitofrontal cortex (lOFC) or prelimbic (PrL) area of the medial prefrontal cortex (mPFC). A total of 32 male Long–Evans rats were trained on the cued version of the rat gambling task (rGT), a rodent analog of the human Iowa gambling task, and bilateral guide cannulae were implanted into the lOFC or PrL. Intra-lOFC infusions of the 5-HT_2C antagonist RS 102221 reduced risky choice in animals that showed a preference for the risky options of the rGT at baseline. This effect was not observed in optimal decision-makers, nor those that received infusions targeting the PrL. Given prior data showing that 5-HT_2C antagonists also improve reversal learning through the same neural locus, we hypothesized that reward-concurrent cues may amplify risky decision-making through cognitive inflexibility. We therefore devalued the sugar pellet rewards used in the cued rGT (crGT) through satiation and observed that decision-making patterns did not shift unless animals also received intra-lOFC RS 102221. Collectively, these data suggest that the lOFC is one critical site through which reward-concurrent cues promote risky choice patterns that are insensitive to reinforcer devaluation, and that 5-HT_2C antagonism may optimize choice by facilitating exploration.

Is the core function of orbitofrontal cortex to signal values or make predictions?

One dominant hypothesis about the function of the orbitofrontal cortex (OFC) is that the OFC signals the subjective values of possible outcomes to other brain areas for learning and decision making. This popular view generally neglects the fact that OFC is not necessary for simple value-based behavior (i.e., when values have been directly experienced). An alternative, emerging view suggests that OFC plays a more general role in representing structural information about the task or environment, derived from prior experience, and relevant to predicting behavioral outcomes, such as value. From this perspective, value signaling is simply one derivative of the core underlying function of OFC. New data in favor of both views have been accumulating rapidly. Here we review these new data in discussing the relative merits of these two ideas.

Metabotropic group II glutamate receptors in the basolateral amygdala mediate cue-triggered increases in incentive motivation

RATIONALE

Reward-associated cues can trigger incentive motivation for reward and invigorate reward-seeking behaviour via Pavlovian-to-instrumental transfer (PIT). Glutamate signaling within the basolateral amygdala (BLA) modulates cue-triggered increases in incentive motivation. However, the role of BLA metabotropic group II glutamate (mGlu_2/3) receptors is largely unknown.

OBJECTIVES

In Experiment 1, we characterized cue-triggered increases in incentive motivation for water reward using the PIT paradigm. In Experiment 2, we assessed the influence of intra-BLA microinjections of the mGlu_2/3 receptor agonist LY379268 on this effect.

METHODS

Water-restricted male Sprague-Dawley rats learned to press a lever for water. Separately, they learned to associate one of two auditory cues with free water. On test days, rats could lever press under extinction conditions (no water), with intermittent, non-contingent CS+ and CS- presentations. In Experiment 1, rats were tested under baseline conditions. In Experiment 2, rats received intra-BLA microinjections of LY379268 (0, 3 and 6 [Formula: see text]g/hemisphere) before testing.

RESULTS

Across experiments, CS+, but not CS-, presentations increased water-associated lever pressing during testing, even though responding was reinforced neither by water nor the CS+. Intra-BLA LY379268 abolished both CS+ potentiated pressing on the water-associated lever and CS+ evoked conditioned approach to the site of water delivery. LY379268 did not influence locomotion or instrumental and Pavlovian response rates during intervals between CS presentations or during the CS-, indicating no motor effects.

CONCLUSIONS

mGlu_2/3 receptor activity in the BLA mediates cue-triggered potentiation of incentive motivation for reward, suppressing both cue-induced increases in instrumental pursuit of the reward and anticipatory approach behaviour.

Another look at the extinction of conditioned flavor preferences: Amount of training and tests for spontaneous recovery

A conditioned flavor preference develops when hungry or thirsty rats experience a neutral flavor mixed in solution with a nutrient. In two sets of studies, we previously demonstrated that this learned preference is highly sensitive to flavor nonreinforcement (i.e., exposure to the flavor without the nutrient) either prior to (latent inhibition), during (partial reinforcement), or following (extinction) flavor-nutrient pairings. In each of these studies we employed a nutrient devaluation procedure to assess the integrity of specific flavor-nutrient associations following extinction, but more recently Gonzalez, Morillas, and Hall (Journal of Experimental Psychology: Animal Learning & Cognition, 42, 380-390, 2016) observed that sensitivity to extinction in thirsty rats in this preparation may depend upon use of a post-conditioning nutrient devaluation procedure. To assess the generality of our earlier results, but without including a post-conditioning nutrient devaluation phase, we assessed in three experiments the role of the number of flavor-nutrient pairings given prior to extinction and the possibility of spontaneous recovery following a 3-week delay. We observed that extinction consistently weakened the flavor preference in thirsty rats (in spite of the absence of a nutrient devaluation procedure) and also found no evidence for spontaneous recovery. These results establish that our prior findings that conditioned flavor preferences are weakened by extinction are quite robust in thirsty rats and that these extinction effects may be fairly permanent.

Ethanol modulation of cortico-basolateral amygdala circuits: Neurophysiology and behavior

This review highlights literature relating the anatomy, physiology, and behavioral contributions by projections between rodent prefrontal cortical areas and the basolateral amygdala. These projections are robustly modulated by both environmental experience and exposure to drugs of abuse including ethanol. Recent literature relating optogenetic and chemogenetic dissection of these circuits within behavior both compliments and occasionally challenges roles defined by more traditional pharmacological or lesion-based approaches. In particular, cortico-amygdala circuits help control both aversive and reward-seeking. Exposure to pathology-producing environments or abused drugs dysregulates the relative 'balance' of these outcomes. Modern circuit-based approaches have also shown that overlapping populations of neurons within a given brain region frequently govern both aversion and reward-seeking. In addition, these circuits often dramatically influence 'local' cortical or basolateral amygdala excitatory or inhibitory circuits. Our understanding of these neurobiological processes, particularly in relation to ethanol research, has just begun and represents a significant opportunity.

Chemogenetic inhibition of prefrontal projection neurons constrains top-down control of attention in young but not aged rats

The prefrontal cortex (PFC) governs top-down control of attention and is known to be vulnerable in aging. Cortical reorganization with increased PFC recruitment is suggested to account for functional compensation. Here, we hypothesized that reduced PFC output would exert differential effects on attentional capacities in young and aged rats, with the latter exhibiting a more robust decline in performance. A chemogenetic approach involving designer receptors exclusively activated by designer drugs was utilized to determine the impact of silencing PFC projection neurons in rats performing an operant attention task. Visual distractors were presented in all behavioral testing sessions to tax attentional resources. Under control conditions, aged rats exhibited impairments in discriminating signals with the shortest duration from non-signal events. Surprisingly, chemogenetic inhibition of PFC output neurons did not worsen performance amongst aged animals. Conversely, significant impairments in attentional capacities were observed in young subjects following such manipulation. Given the involvement of PFC-projecting basal forebrain cholinergic neurons in top-down regulation of attention, amperometric recordings were conducted to measure alterations in prefrontal cholinergic transmission in a separate cohort of young and aged rats. While PFC silencing resulted in a robust attenuation of tonic cholinergic signaling across age groups, the capacity to generate phasic cholinergic transients was impaired only amongst young animals. Collectively, our findings suggest a reduced efficiency of PFC-mediated top-down control of attention and cholinergic system in aging, and that activity of PFC output neurons does not reflect compensation in aged rats, at least in the attention domain.

Choose your path: Divergent basolateral amygdala efferents differentially mediate incentive motivation, flexibility and decision-making

To survive in a complex environment, individuals form associations between environmental stimuli and rewards to organize and optimize reward seeking behaviors. The basolateral amygdala (BLA) uses these learned associations to inform decision-making processes. In this review, we describe functional projections between BLA and its cortical and striatal targets that promote learning and motivational processes central to decision-making. Specifically, we compare and contrast divergent projections from the BLA to the orbitofrontal (OFC) and to the nucleus accumbens (NAc) and examine the roles of these pathways in associative learning, value-guided decision-making, choice behaviors, as well as cue and context-driven drug seeking. Finally, we consider how these projections are involved in disorders of motivation, with a focus on Substance Use Disorder.

Cell Adhesion Factors in the Orbitofrontal Cortex Control Cue-Induced Reinstatement of Cocaine Seeking and Amygdala-Dependent Goal Seeking

Repeated cocaine exposure causes dendritic spine loss in the orbitofrontal cortex, which might contribute to poor orbitofrontal cortical function following drug exposure. One challenge, however, has been verifying links between neuronal structural plasticity and behavior, if any. Here we report that cocaine self-administration triggers the loss of dendritic spines on excitatory neurons in the orbitofrontal cortex of male and female mice (as has been reported in rats). To understand functional consequences, we locally ablated neuronal β1-integrins, cell adhesion receptors that adhere cells to the extracellular matrix and thus support dendritic spine stability. Degradation of β1-integrin tone: (1) caused dendritic spine loss, (2) exaggerated cocaine-seeking responses in a cue-induced reinstatement test, and (3) impaired the ability of mice to integrate new learning into familiar routines, a key function of the orbitofrontal cortex. Stimulating Abl-related gene kinase, overexpressing Proline-rich tyrosine kinase, and inhibiting Rho-associated coiled-coil containing kinase corrected response strategies, uncovering a β1-integrin-mediated signaling axis that controls orbitofrontal cortical function. Finally, use of a combinatorial gene silencing/chemogenetic strategy revealed that β1-integrins support the ability of mice to integrate new information into established behaviors by sustaining orbitofrontal cortical connections with the basolateral amygdala.SIGNIFICANCE STATEMENT Cocaine degenerates dendritic spines in the orbitofrontal cortex, a region of the brain involved in interlacing new information into established behaviors. One challenge has been verifying links between cellular structural stability and behavior, if any. In this second of two related investigations, we study integrin family receptors, which adhere cells to the extracellular matrix and thereby stabilize dendritic spines (see also DePoy et al., 2019). We reveal that β1-integrins in the orbitofrontal cortex control food- and cocaine-seeking behaviors. For instance, β1-integrin loss amplifies cocaine-seeking behavior and impairs the ability of mice to integrate new learning into familiar routines. We identify likely intracellular signaling partners by which β1-integrins support orbitofrontal cortical function and connectivity with the basolateral amygdala.

Mechanisms of higher-order learning in the amygdala

Adaptive behaviour is under the potent control of environmental cues. Such cues can acquire value by virtue of their associations with outcomes of motivational significance, be they appetitive or aversive. There are at least two ways through which an environmental cue can acquire value, through first-order and higher-order conditioning. In first-order conditioning, a neutral cue is directly paired with an outcome of motivational significance. In higher-order conditioning, a cue is indirectly associated with motivational events via a directly conditioned first-order stimulus. The present article reviews some of the associations that support learning in first- and higher-order conditioning, as well as the role of the BLA and the molecular mechanisms involved in these two types of learning.