Amygdala neurons differentially encode motivation and reinforcement

Differential functions of the dorsal and intermediate regions of the hippocampus for optimal goal-directed navigation in VR space

Goal-directed navigation requires the hippocampus to process spatial information in a value-dependent manner, but its underlying mechanism needs to be better understood. Here, we investigated whether the dorsal (dHP) and intermediate (iHP) regions of the hippocampus differentially function in processing place and its associated value information. Rats were trained in a place-preference task involving reward zones with different values in a visually rich virtual reality environment where two-dimensional navigation was possible. Rats learned to use distal visual scenes effectively to navigate to the reward zone associated with a higher reward. Inactivation of both dHP and iHP with muscimol altered the efficiency and precision of wayfinding behavior, but iHP inactivation induced more severe damage, including impaired place preference. Our findings suggest that the iHP is more critical for value-dependent navigation toward higher-value goal locations.

Memory consolidation drives the enhancement of remote cocaine memory via prefrontal circuit

Remote memory usually decreases over time, whereas remote drug-cue associated memory exhibits enhancement, increasing the risk of relapse during abstinence. Memory system consolidation is a prerequisite for remote memory formation, but neurobiological underpinnings of the role of consolidation in the enhancement of remote drug memory are unclear. Here, we found that remote cocaine-cue associated memory was enhanced in rats that underwent self-administration training, together with a progressive increase in the response of prelimbic cortex (PrL) CaMKII neurons to cues. System consolidation was required for the enhancement of remote cocaine memory through PrL CaMKII neurons during the early period post-training. Furthermore, dendritic spine maturation in the PrL relied on the basolateral amygdala (BLA) input during the early period of consolidation, contributing to remote memory enhancement. These findings indicate that memory consolidation drives the enhancement of remote cocaine memory through a time-dependent increase in activity and maturation of PrL CaMKII neurons receiving a sustained BLA input.

Dissociable Contributions of Basolateral Amygdala and Ventrolateral Orbitofrontal Cortex to Flexible Learning Under Uncertainty

Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including the highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, the unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory designer receptors exclusively activated by designer drugs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-/post-reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of the ventrolateral orbitofrontal cortex (vlOFC), but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.

Basolateral amygdala population coding of a cued reward seeking state depends on orbitofrontal cortex

Basolateral amygdala (BLA) neuronal responses to conditioned stimuli are closely linked to the expression of conditioned behavior. An area of increasing interest is how the dynamics of BLA neurons relate to evolving behavior. Here, we recorded the activity of individual BLA neurons across the acquisition and extinction of conditioned reward seeking and employed population-level analyses to assess ongoing neural dynamics. We found that, with training, sustained cue-evoked activity emerged that discriminated between the CS+ and CS- and correlated with conditioned responding. This sustained population activity continued until reward receipt and rapidly extinguished along with conditioned behavior during extinction. To assess the contribution of orbitofrontal cortex (OFC), a major reciprocal partner to BLA, to this component of BLA neural activity, we inactivated OFC while recording in BLA and found blunted sustained cue-evoked activity in BLA that accompanied reduced reward seeking. Optogenetic disruption of BLA activity and OFC terminals in BLA also reduced reward seeking. Our data suggest that sustained cue-driven activity in BLA, which in part depends on OFC input, underlies conditioned reward-seeking states.

Cue- versus reward-encoding basolateral amygdala projections to nucleus accumbens

In substance use disorders, drug use as unconditioned stimulus (US) reinforces drug taking. Meanwhile, drug-associated cues (conditioned stimulus [CS]) also gain incentive salience to promote drug seeking. The basolateral amygdala (BLA) is implicated in both US- and CS-mediated responses. Here, we show that two genetically distinct BLA neuronal types, expressing Rspo2 versus Ppp1r1b, respectively, project to the nucleus accumbens (NAc) and form monosynaptic connections with both dopamine D1 and D2 receptor-expressing neurons. While intra-NAc stimulation of Rspo2 or Ppp1r1b presynaptic terminals establishes intracranial self-stimulation (ICSS), only Ppp1r1b-stimulated mice exhibit cue-induced ICSS seeking. Furthermore, increasing versus decreasing the Ppp1r1b-to-NAc, but not Rspo2-to-NAc, subprojection increases versus decreases cue-induced cocaine seeking after cocaine withdrawal. Thus, while both BLA-to-NAc subprojections contribute to US-mediated responses, the Ppp1r1b subprojection selectively encodes CS-mediated reward and drug reinforcement. Such differential circuit representations may provide insights into precise understanding and manipulation of drug- versus cue-induced drug seeking and relapse.

Dissociable contributions of basolateral amygdala and ventrolateral orbitofrontal cortex to flexible learning under uncertainty

Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach and particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory DREADDs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-post reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of vlOFC, but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.

Inhibitory and excitatory alcohol-seeking cues distinct roles in behavior, neurochemistry, and mesolimbic pathway in alcohol preferring (P) rats

Cues associated with alcohol use can readily enhance self-reported cravings for alcohol, which increases the likelihood of reusing alcohol. Understanding the neuronal mechanisms involved in alcohol-seeking behavior is important for developing strategies to treat alcohol use disorder. In all experiments, adult female alcohol-preferring (P) rats were exposed to three conditioned odor cues; CS+ associated with EtOH self-administration, CS- associated with the absence of EtOH (extinction training), and a CS0, a neutral stimulus. The data indicated that presentation of an excitatory conditioned cue (CS+) can enhance EtOH- seeking while the CS- can inhibit EtOH-seeking under multiple test conditions. Presentation of the CS+ activates a subpopulation of dopamine neurons within the interfascicular nucleus of the posterior ventral tegmental area (posterior VTA) and basolateral amygdala (BLA). Pharmacological inactivation of the BLA with GABA agonists inhibits the ability of the CS+ to enhance EtOH-seeking but does not alter context-induced EtOH-seeking or the ability of the CS- to inhibit EtOH-seeking. Presentation of the conditioned odor cues in a non-drug-paired environment indicated that presentation of the CS+ increased dopamine levels in the BLA. In contrast, presentation of the CS- decreased both glutamate and dopamine levels in the BLA. Further analysis revealed that presentation of a CS+ EtOH-associated conditioned cue activates GABA interneurons but not glutamate projection neurons. Overall, the data indicate that excitatory and inhibitory conditioned cues can contrarily alter EtOH-seeking behaviors and that different neurocircuitries are mediating these distinct cues in critical brain regions. Pharmacotherapeutics for craving should inhibit the CS+ and enhance the CS- neurocircuits.

Basolateral amygdala and orbitofrontal cortex, but not dorsal hippocampus, are necessary for the control of reward-seeking by occasion setters

Reward-seeking in the world is driven by cues that can have ambiguous predictive and motivational value. To produce adaptive, flexible reward-seeking, it is necessary to exploit occasion setters, other distinct features in the environment, to resolve the ambiguity of Pavlovian reward-paired cues. Despite this, very little research has investigated the neurobiological underpinnings of occasion setting, and as a result little is known about which brain regions are critical for occasion setting. To address this, we exploited a recently developed task that was amenable to neurobiological inquiry where a conditioned stimulus is only predictive of reward delivery if preceded in time by the non-overlapping presentation of a separate cue-an occasion setter. This task required male rats to maintain and link cue-triggered expectations across time to produce adaptive reward-seeking. We interrogated the contributions of the basolateral amygdala and orbitofrontal cortex to occasion setting as these regions are thought to be critical for the computation and exploitation of state value, respectively. Reversible inactivation of either structure prior to the occasion-setting task resulted in a profound inability of rats to use the occasion setter to guide reward-seeking. In contrast, inactivation of the dorsal hippocampus, a region fundamental for context-specific responding was without effect nor did inactivation of the basolateral amygdala or orbitofrontal cortex in a standard Pavlovian conditioning preparation affect conditioned responding. We conclude that neural activity within the orbitofrontal cortex and basolateral amygdala circuit is necessary to update and resolve ambiguity in the environment to promote cue-driven reward-seeking.

A context-dependent switch from sensing to feeling in the primate amygdala

The skin transmits affective signals that integrate into our social vocabulary. As the socio-affective aspects of touch are likely processed in the amygdala, we compare neural responses to social grooming and gentle airflow recorded from the amygdala and the primary somatosensory cortex of non-human primates. Neurons in the somatosensory cortex respond to both types of tactile stimuli. In the amygdala, however, neurons do not respond to individual grooming sweeps even though grooming elicits autonomic states indicative of positive affect. Instead, many show changes in baseline firing rates that persist throughout the grooming bout. Such baseline fluctuations are attributed to social context because the presence of the groomer alone can account for the observed changes in baseline activity. It appears, therefore, that during grooming, the amygdala stops responding to external inputs on a short timescale but remains responsive to social context (or the associated affective states) on longer time scales.

The Recruitment of a Neuronal Ensemble in the Central Nucleus of the Amygdala During the First Extinction Episode Has Persistent Effects on Extinction Expression

BACKGROUND

Adaptive behavior depends on the delicate and dynamic balance between acquisition and extinction memories. Disruption of this balance, particularly when the extinction of memory loses control over behavior, is the root of treatment failure of maladaptive behaviors such as substance abuse or anxiety disorders. Understanding this balance requires a better understanding of the underlying neurobiology and its contribution to behavioral regulation.

METHODS

We microinjected Daun02 in Fos-lacZ transgenic rats following a single extinction training episode to delete extinction-recruited neuronal ensembles in the basolateral amygdala (BLA) and central nucleus of the amygdala (CN) and examined their contribution to behavior in an appetitive Pavlovian task. In addition, we used immunohistochemistry and neuronal staining methods to identify the molecular markers of activated neurons in the BLA and CN during extinction learning or retrieval.

RESULTS

CN neurons were preferentially engaged following extinction, and deletion of these extinction-activated ensembles in the CN but not the BLA impaired the retrieval of extinction despite additional extinction training and promoted greater levels of behavioral restoration in spontaneous recovery and reinstatement. Disrupting extinction processing in the CN in turn increased activity in the BLA. Our results also show a specific role for CN PKCδ+ neurons in behavioral inhibition but not during initial extinction learning.

CONCLUSIONS

We showed that the initial extinction-recruited CN ensemble is critical to the acquisition-extinction balance and that greater behavioral restoration does not mean weaker extinction contribution. These findings provide a novel avenue for thinking about the neural mechanisms of extinction and for developing treatments for cue-triggered appetitive behaviors.

Trial-by-trial fluctuations in amygdala activity track motivational enhancement of desirable sensory evidence during perceptual decision-making

People are biased toward seeing outcomes that they are motivated to see. For example, wanting their favored team to prevail biases sports fans to perceive an ambiguous foul in a manner that is favorable to the team they support. Here, we test the hypothesis that such motivational biases in perceptual decision-making are associated with amygdala activity. We used monetary incentives to experimentally manipulate participants to want to see one percept over another while they performed a categorization task involving ambiguous images. Participants were more likely to categorize an image as the category we motivated them to see, suggesting that wanting to see a particular percept biased their perceptual decisions. Heightened amygdala activity was associated with motivation consistent categorizations and tracked trial-by-trial enhancement of neural activity in sensory cortices encoding the desirable category. Analyses using a drift diffusion model further suggest that trial-by-trial amygdala activity was specifically associated with biases in the accumulation of sensory evidence. In contrast, frontoparietal regions commonly associated with biases in perceptual decision-making were not associated with motivational bias. Altogether, our results suggest that wanting to see an outcome biases perceptual decisions via distinct mechanisms and may depend on dynamic fluctuations in amygdala activity.

Necessity and recruitment of cue-specific neuronal ensembles within the basolateral amygdala during appetitive reversal learning

Through Pavlovian appetitive conditioning, environmental cues can become predictors of food availability. Over time, however, the food, and thus the value of the associated cues, can change based on environmental variations. This change in outcome necessitates updating of the value of the cue to appropriately alter behavioral responses to these cues. The basolateral amygdala (BLA) is critical in updating the outcomes of learned cues. However, it is unknown if the same BLA neuronal ensembles that are recruited in the initial associative memory are required when the new cue-outcome association is formed during reversal learning. The current study used the Daun02 inactivation method that enables selective targeting and disruption of activated neuronal ensembles in Fos-lacZ transgenic rats. Rats were implanted with bilateral cannulas that target the BLA and underwent appetitive discriminative conditioning in which rats had to discriminate between two auditory stimuli. One stimulus (CS+) co-terminated with food delivery, and the other stimulus was unrewarded (CS-; counterbalanced). Rats were then tested for CS+ or CS- memory retrieval and infused with either Daun02 or a vehicle solution into the BLA to inactivate either CS+ or CS- neuronal ensembles that were activated during that test. To assess if the same neuronal ensembles are necessary to update the value of the new association when the outcomes are changed, rats underwent reversal learning: the CS+ was no longer followed by food (reversal CS-, rCS-), and the CS- was now followed by food (reversal CS+; rCS+). The group that received Daun02 following CS+ session showed a decrease in conditioned responding and increased latency to the rCS- (previously CS+) during the first session of reversal learning, specifically during the first trial. This indicates that the neuronal ensemble that was activated during the recall of the CS+ memory was the same neuronal ensemble needed for learning the new outcome of the same CS, now rCS-. Additionally, the group that received Daun02 following CS- session was slower to respond to the rCS+ (previously CS-) during reversal learning. This indicates that the neuronal ensemble that was activated during the recall of the CS- memory was the same neuronal ensemble needed for learning the new outcome of the same CS. These results demonstrate that different neuronal ensembles within the BLA mediate memory recall of CS+ and CS- cues and reactivation of each cue-specific neuronal ensemble is necessary to update the value of that specific cue to respond appropriately during reversal learning. These results also indicate substantial plasticity within the BLA for behavioral flexibility as both groups eventually showed similar terminal levels of reversal learning.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

Modulation of Emotion Perception via Amygdala Stimulation in Humans

Background

Multiple lines of evidence show that the human amygdala is part of a neural network important for perception of emotion from environmental stimuli, including for processing of intrinsic attractiveness/“goodness” or averseness/“badness,” i.e., affective valence.

Objective/Hypothesis

With this in mind, we investigated the effect of electrical brain stimulation of the human amygdala on perception of affective valence of images taken from the International Affective Picture Set (IAPS).

Methods

Using intracranial electrodes in patients with epilepsy, we first obtained event-related potentials (ERPs) in eight patients as they viewed IAPS images of varying affective valence. Next, in a further cohort of 10 patients (five female and five male), we measured the effect of 50 Hz electrical stimulation of the left amygdala on perception of affective valence from IAPS images.

Results

We recorded distinct ERPs from the left amygdala and found significant differences in the responses between positively and negatively valenced stimuli (p = 0.002), and between neutral and negatively valenced stimuli (p = 0.017) 300–500 ms after stimulus onset. Next, we found that amygdala stimulation did not significantly affect how patients perceived valence for neutral images (p = 0.58), whereas stimulation induced patients to report both positively (p = 0.05) and negatively (< 0.01) valenced images as more neutral.

Conclusion

These results render further evidence that the left amygdala participates in a neural network for perception of emotion from environmental stimuli. These findings support the idea that electrical stimulation disrupts this network and leads to partial disruption of perception of emotion. Harnessing this effect may have clinical implications in treatment of certain neuropsychiatric disorders using deep brain stimulation (DBS) and neuromodulation.

A neuronal mechanism for motivational control of behavior

Acting to achieve goals depends on the ability to motivate specific behaviors based on their predicted consequences given an individual’s internal state. However, the underlying neuronal mechanisms that encode and maintain such specific motivational control of behavior are poorly understood. Here, we used Ca²⁺ imaging and optogenetic manipulations in the basolateral amygdala of freely moving mice performing noncued, self-paced instrumental goal-directed actions to receive and consume rewards. We found that distinct neuronal activity patterns sequentially represent the entire action-consumption behavioral sequence. Whereas action-associated patterns integrated the identity, value, and expectancy of pursued goals, consumption-associated patterns reflected the identity and value of experienced outcomes. Thus, the interplay between these patterns allows the maintenance of specific motivational states necessary to adaptively direct behavior toward prospective rewards.

Chronic alcohol exposure during critical developmental periods differentially impacts persistence of deficits in cognitive flexibility and related circuitry

Cognitive flexibility in decision making depends on prefrontal cortical function and is used by individuals to adapt to environmental changes in circumstances. Cognitive flexibility can be measured in the laboratory using a variety of discrete, translational tasks, including those that involve reversal learning and/or set-shifting ability. Distinct components of flexible behavior rely upon overlapping brain circuits, including different prefrontal substructures that have separable impacts on decision making. Cognitive flexibility is impaired after chronic alcohol exposure, particularly during development when the brain undergoes rapid maturation. This review examines how cognitive flexibility, as indexed by reversal and set-shifting tasks, is impacted by chronic alcohol exposure in adulthood, adolescent, and prenatal periods in humans and animal models. We also discuss areas for future study, including mechanisms that may contribute to the persistence of cognitive deficits after developmental alcohol exposure and the compacting consequences from exposure across multiple critical periods.

Choose your path: Divergent basolateral amygdala efferents differentially mediate incentive motivation, flexibility and decision-making

To survive in a complex environment, individuals form associations between environmental stimuli and rewards to organize and optimize reward seeking behaviors. The basolateral amygdala (BLA) uses these learned associations to inform decision-making processes. In this review, we describe functional projections between BLA and its cortical and striatal targets that promote learning and motivational processes central to decision-making. Specifically, we compare and contrast divergent projections from the BLA to the orbitofrontal (OFC) and to the nucleus accumbens (NAc) and examine the roles of these pathways in associative learning, value-guided decision-making, choice behaviors, as well as cue and context-driven drug seeking. Finally, we consider how these projections are involved in disorders of motivation, with a focus on Substance Use Disorder.

A bidirectional corticoamygdala circuit for the encoding and retrieval of detailed reward memories

Adaptive reward-related decision making often requires accurate and detailed representation of potential available rewards. Environmental reward-predictive stimuli can facilitate these representations, allowing one to infer which specific rewards might be available and choose accordingly. This process relies on encoded relationships between the cues and the sensory-specific details of the rewards they predict. Here, we interrogated the function of the basolateral amygdala (BLA) and its interaction with the lateral orbitofrontal cortex (lOFC) in the ability to learn such stimulus-outcome associations and use these memories to guide decision making. Using optical recording and inhibition approaches, Pavlovian cue-reward conditioning, and the outcome-selective Pavlovian-to-instrumental transfer (PIT) test in male rats, we found that the BLA is robustly activated at the time of stimulus-outcome learning and that this activity is necessary for sensory-specific stimulus-outcome memories to be encoded, so they can subsequently influence reward choices. Direct input from the lOFC was found to support the BLA in this function. Based on prior work, activity in BLA projections back to the lOFC was known to support the use of stimulus-outcome memories to influence decision making. By multiplexing optogenetic and chemogenetic inhibition we performed a serial circuit disconnection and found that the lOFC→BLA and BLA→lOFC pathways form a functional circuit regulating the encoding (lOFC→BLA) and subsequent use (BLA→lOFC) of the stimulus-dependent, sensory-specific reward memories that are critical for adaptive, appetitive decision making.

Longitudinal recordings of single units in the basal amygdala during fear conditioning and extinction

The balance between activities of fear neurons and extinction neurons in the basolateral nucleus of the basal amygdala (BAL) has been hypothesized to encode fear states after extinction. However, it remains unclear whether these neurons are solely responsible for encoding fear states. In this study, we stably recorded single-unit activities in the BAL during fear conditioning and extinction for 3 days, providing a comprehensive view on how different BAL neurons respond during fear learning. We found BAL neurons that showed excitatory responses to the conditioned stimulus (CS) after fear conditioning ('conditioning-potentiated neurons') and another population that showed excitatory responses to the CS after extinction ('extinction-potentiated neurons'). Interestingly, we also found BAL neurons that developed inhibitory responses to the CS after fear conditioning ('conditioning-inhibited neurons') or after extinction ('extinction-inhibited neurons'). BAL neurons that showed excitatory responses to the CS displayed various functional connectivity with each other, whereas less connectivity was observed among neurons with inhibitory responses to the CS. Intriguingly, we found correlative neuronal activities between conditioning-potentiated neurons and neurons with inhibitory responses to the CS. Our findings suggest that distinct BAL neurons, which are responsive to the CS with excitation or inhibition, encode various facets of fear conditioning and extinction.

Valence encoding in the amygdala influences motivated behavior

The amygdala is critical for emotional processing and motivated behavior. Its role in these functions is due to its processing of the valence of environmental stimuli. The amygdala receives direct sensory input from sensory thalamus and cortical regions to integrate sensory information from the environment with aversive and/or appetitive outcomes. As many reviews have discussed the amygdala's role in threat processing and fear conditioning, this review will focus on how the amygdala encodes positive valence and the mechanisms that allow it to distinguish between stimuli of positive and negative valence. These findings are also extended to consider how valence encoding populations in the amygdala contribute to local and long-range circuits including those that integrate environmental cues and positive valence. Understanding the complexity of valence encoding in the amygdala is crucial as these mechanisms are implicated in a variety of disease states including anxiety disorders and substance use disorders.

Prediction errors and valence: From single units to multidimensional encoding in the amygdala

The amygdala-one of the primary structures of the limbic system-is comprised of interconnected nuclei situated within the temporal lobe. It has a well-established role in the modulation of negative affective states, as well as in fear processing. However, its vast projections with diverse brain regions-ranging from the cortex to the brainstem-are suggestive of its more complex involvement in affective or motivational aspects of cognitive processing. The amygdala can play an invaluable role in context-dependent associative learning, unsigned prediction error learning, influencing outcome selection, and multidimensional encoding. In this review, we delve into the amygdala's role in associative learning and outcome selection, emphasizing its intrinsic involvement in the appropriate context-dependent modulation of motivated behavior.

Acetylcholine is released in the basolateral amygdala in response to predictors of reward and enhances the learning of cue-reward contingency

The basolateral amygdala (BLA) is critical for associating initially neutral cues with appetitive and aversive stimuli and receives dense neuromodulatory acetylcholine (ACh) projections. We measured BLA ACh signaling and activity of neurons expressing CaMKIIα (a marker for glutamatergic principal cells) in mice during cue-reward learning using a fluorescent ACh sensor and calcium indicators. We found that ACh levels and nucleus basalis of Meynert (NBM) cholinergic terminal activity in the BLA (NBM-BLA) increased sharply in response to reward-related events and shifted as mice learned the cue-reward contingency. BLA CaMKIIα neuron activity followed reward retrieval and moved to the reward-predictive cue after task acquisition. Optical stimulation of cholinergic NBM-BLA terminal fibers led to a quicker acquisition of the cue-reward contingency. These results indicate BLA ACh signaling carries important information about salient events in cue-reward learning and provides a framework for understanding how ACh signaling contributes to shaping BLA responses to emotional stimuli.

Brain-behaviour correlates of habitual motivation in chronic back pain

Chronic pain may sap the motivation for positive events and stimuli. This may lead to a negative behavioural cycle reducing the establishment of appetitive habitual engagement. One potential mechanism for this might be biased learning. In our experiment, chronic back pain patients and healthy controls completed an appetitive Pavlovian-instrumental transfer procedure. We examined participants` behaviour and brain activity and reported pain, depression and anxiety. Patients showed reduced habitual behaviour and increased responses in the hippocampus than controls. This behavioural bias was related to motivational value and reflected in the updating of brain activity in prefrontal–striatal–limbic circuits. Moreover, this was influenced by pain symptom duration, depression and anxiety (explained variance: up to 50.7%). Together, findings identify brain-behaviour pathways for maladaptive habitual learning and motivation in chronic back pain, which helps explaining why chronic pain can be resistant to change, and where clinical characteristics are significant modulators.

Optogenetic Activation of the Basolateral Amygdala Promotes Both Appetitive Conditioning and the Instrumental Pursuit of Reward Cues

Reward-associated stimuli can both evoke conditioned responses and acquire reinforcing properties in their own right, becoming avidly pursued. Such conditioned stimuli (CS) can guide reward-seeking behavior in adaptive (e.g., locating food) and maladaptive (e.g., binge eating) ways. The basolateral amygdala (BLA) regulates conditioned responses evoked by appetitive CS, but less is known about how the BLA contributes to the instrumental pursuit of CS. Here we studied the influence of BLA neuron activity on both behavioral effects. Water-restricted male rats learned to associate a light-tone cue (CS) with water delivery into a port. During these Pavlovian conditioning sessions, we paired CS presentations with photo-stimulation of channelrhodopsin-2 (ChR2)-expressing BLA neurons. BLA photo-stimulation potentiated CS-evoked port entries during conditioning, indicating enhanced conditioned approach and appetitive conditioning. Next, new rats received Pavlovian conditioning without photo-stimulation. These rats then received instrumental conditioning sessions where they could press an inactive lever or an active lever that produced CS presentation, without water delivery. Rats pressed more on the active versus inactive lever, and pairing CS presentation with BLA-ChR2 photo-stimulation intensified responding for the CS. This suggests that BLA-ChR2 photo-stimulation enhanced CS incentive value. In a separate experiment, rats did not reliably self-administer BLA-ChR2 stimulations, suggesting that BLA neurons do not carry a primary reward signal. Last, intra-BLA infusions of d-amphetamine also intensified lever-pressing for the CS. The findings suggest that BLA-mediated activity facilitates CS control over behavior by enhancing both appetitive Pavlovian conditioning and instrumental pursuit of CS.SIGNIFICANCE STATEMENT Cues paired with rewards can guide animals to valuable resources such as food. Cues can also promote dysfunctional reward-seeking behavior, as in overeating. Reward-paired cues influence reward seeking through two major mechanisms. First, reward-paired cues evoke conditioned anticipatory behaviors to prepare for impending rewards. Second, reward-paired cues are powerful motivators and they can evoke pursuit in their own right. Here we show that increasing neural activity in the basolateral amygdala enhances both conditioned anticipatory behaviors and pursuit of reward-paired cues. The basolateral amygdala therefore facilitates cue-induced control over behavior by both increasing anticipation of impending rewards and making reward cues more attractive.

State-specific gating of salient cues by midbrain dopaminergic input to basal amygdala

Basal amygdala (BA) neurons guide associative learning via acquisition of responses to stimuli that predict salient appetitive or aversive outcomes. We examined the learning- and state-dependent dynamics of BA neurons and ventral tegmental area dopamine axons that innervate BA (VTA^DA➜BA) using two-photon imaging and photometry in behaving mice. BA neurons did not respond to arbitrary visual stimuli, but acquired responses to stimuli that predicted either rewards or punishments. Most VTA^DA➜BA axons were activated by both rewards and punishments, and acquired responses to cues predicting these outcomes during learning. Responses to cues predicting food rewards in VTA^DA➜BA axons and BA neurons in hungry mice were strongly attenuated following satiation, while responses to cues predicting unavoidable punishments persisted or increased. Therefore, VTA^DA➜BA axons may provide a reinforcement signal of motivational salience that invigorates adaptive behaviors by promoting learned responses to appetitive or aversive cues in distinct, intermingled sets of BA excitatory neurons.

Lesions of the rat basolateral amygdala reduce the behavioral response to ultrasonic vocalizations

Rats emit vocalizations in the ultrasonic range (ultrasonic vocalizations; USVs), of which 50-kHz USVs could communicate positive affective states and induce approach behavior in conspecifics, whereas 22-kHz USVs might signal negative affective states and potential threats. Listening to 50-kHz USVs can be rewarding, but it is unknown which brain mechanisms are responsible for the assignment of reinforcing value to 50-kHz USVs . The behavioral responses induced by listening to 22-kHz USVs are heterogeneous and need further characterization. The amygdala is a region relevant for social perception, behavior and reward. Here, we tested the hypothesis that the basolateral amygdala (BLA) plays a causal role in motivating behavioral responses to 50-kHz and 22-kHz USVs. Rats with lesions of the BLA or sham lesions were repeatedly exposed to playback of either 50-kHz or 22-kHz USVs in a radial maze. Compared to sham rats, BLA-lesioned rats spent less time in the arms close to the USV speaker during playback of both 50-kHz or 22-kHz USVs. This difference in behavior was not due to impaired motor or general auditory abilities, indicating that BLA lesions selectively reduced the responsiveness to stimuli with social significance. This finding provides further support for the hypothesis that the BLA plays an important role in motivating approach behavior to social reinforcers.

Amygdala ensembles encode behavioral states

Internal states, including affective or homeostatic states, are important behavioral motivators. The amygdala regulates motivated behaviors, yet how distinct states are represented in amygdala circuits is unknown. By longitudinally imaging neural calcium dynamics in freely moving mice across different environments, we identified opponent changes in activity levels of two major, nonoverlapping populations of basal amygdala principal neurons. This population signature does not report global anxiety but predicts switches between exploratory and nonexploratory, defensive states. Moreover, the amygdala separately processes external stimuli and internal states and broadcasts state information via several output pathways to larger brain networks. Our findings extend the concept of thalamocortical "brain-state" coding to include affective and exploratory states and provide an entry point into the state dependency of brain function and behavior in defined circuits.

A Central Amygdala-Substantia Innominata Neural Circuitry Encodes Aversive Reinforcement Signals

Aversive stimuli can impact motivation and support associative learning as reinforcers. However, the neural circuitry underlying the processing of aversive reinforcers has not been elucidated. Here, we report that a subpopulation of central amygdala (CeA) GABAergic neurons expressing protein kinase C-delta (PKC-δ+) displays robust responses to aversive stimuli during negative reinforcement learning. Importantly, projections from PKC-δ+ neurons of the CeA to the substantia innominata (SI) could bi-directionally modulate negative reinforcement learning. Moreover, consistent with the idea that SI-projecting PKC-δ+ neurons of the CeA encode aversive information, optogenetic activation of this pathway produces conditioned place aversion, a behavior prevented by simultaneous ablating of SI glutamatergic neurons. Taken together, our data define a cell-type-specific neural circuitry modulating associative learning by encoding aversive reinforcement signals.

Schizophrenia-Related Microdeletion Impairs Emotional Memory through MicroRNA-Dependent Disruption of Thalamic Inputs to the Amygdala

Individuals with 22q11.2 deletion syndrome (22q11DS) are at high risk of developing psychiatric diseases such as schizophrenia. Individuals with 22q11DS and schizophrenia are impaired in emotional memory, anticipating, recalling, and assigning a correct context to emotions. The neuronal circuits responsible for these emotional memory deficits are unknown. Here, we show that 22q11DS mouse models have disrupted synaptic transmission at thalamic inputs to the lateral amygdala (thalamo-LA projections). This synaptic deficit is caused by haploinsufficiency of the 22q11DS gene Dgcr8, which is involved in microRNA processing, and is mediated by the increased dopamine receptor Drd2 levels in the thalamus and by reduced probability of glutamate release from thalamic inputs. This deficit in thalamo-LA synaptic transmission is sufficient to cause fear memory deficits. Our results suggest that dysregulation of the Dgcr8–Drd2 mechanism at thalamic inputs to the amygdala underlies emotional memory deficits in 22q11DS.

•

Thalamic inputs to the lateral amygdala (LA) are impaired in 22q11DS mice

•

Thalamo-LA disruption is sufficient to cause associative fear memory deficits

•

Deficiency in microRNA-processing Dgcr8 causes thalamo-LA and fear memory deficits

•

Fear memory deficits in 22q11DS mice are rescued by thalamic Drd2 inhibition

Optogenetic activation of amygdala projections to nucleus accumbens can arrest conditioned and unconditioned alcohol consummatory behavior

Following a Pavlovian pairing procedure, alcohol-paired cues come to elicit behavioral responses that lead to alcohol consumption. Here we used an optogenetic approach to activate basolateral amygdala (BLA) axonal terminals targeting the shell of nucleus accumbens (AcbSh) and investigated a possible influence over cue-conditioned alcohol seeking and alcohol drinking, based on the demonstrated roles of these areas in behavioral responding to Pavlovian cues and in feeding behavior. Rats were trained to anticipate alcohol or sucrose following the onset of a discrete conditioned stimulus (CS). Channelrhodopsin-mediated activation of the BLA-to-AcbSh pathway concurrent with each CS disrupted cued alcohol seeking. Activation of the same pathway caused rapid cessation of alcohol drinking from a sipper tube. Neither effect was accompanied by an overall change in locomotion. Finally, the suppressive effect of photoactivation on cued-triggered seeking was also evidenced in animals trained with sucrose. Together these findings suggest that photoactivation of BLA terminals in the AcbSh can override the conditioned motivational properties of reward-predictive cues as well as unconditioned consummatory responses necessary for alcohol drinking. The findings provide evidence for a limbic-striatal influence over motivated behavior for orally consumed rewards, including alcohol.

Nucleus accumbens feedforward inhibition circuit promotes cocaine self-administration

The basolateral amygdala (BLA) sends excitatory projections to the nucleus accumbens (NAc) and regulates motivated behaviors partially by activating NAc medium spiny neurons (MSNs). Here, we characterized a feedforward inhibition circuit, through which BLA-evoked activation of NAc shell (NAcSh) MSNs was fine-tuned by GABAergic monosynaptic innervation from adjacent fast-spiking interneurons (FSIs). Specifically, BLA-to-NAcSh projections predominantly innervated NAcSh FSIs compared with MSNs and triggered action potentials in FSIs preceding BLA-mediated activation of MSNs. Due to these anatomical and temporal properties, activation of the BLA-to-NAcSh projection resulted in a rapid FSI-mediated inhibition of MSNs, timing-contingently dictating BLA-evoked activation of MSNs. Cocaine self-administration selectively and persistently up-regulated the presynaptic release probability of BLA-to-FSI synapses, entailing enhanced FSI-mediated feedforward inhibition of MSNs upon BLA activation. Experimentally enhancing the BLA-to-FSI transmission in vivo expedited the acquisition of cocaine self-administration. These results reveal a previously unidentified role of an FSI-embedded circuit in regulating NAc-based drug seeking and taking.

Decline of prefrontal cortical-mediated executive functions but attenuated delay discounting in aged Fischer 344 × brown Norway hybrid rats

Despite the fact that prefrontal cortex (PFC) function declines with age, aged individuals generally show an enhanced ability to delay gratification, as evident by less discounting of delayed rewards in intertemporal choice tasks. The present study was designed to evaluate relationships between 2 aspects of PFC-dependent cognition (working memory and cognitive flexibility) and intertemporal choice in young (6 months) and aged (24 months) Fischer 344 × brown Norway F1 hybrid rats. Rats were also evaluated for motivation to earn rewards using a progressive ratio task. As previously reported, aged rats showed attenuated discounting of delayed rewards, impaired working memory, and impaired cognitive flexibility compared with young. Among aged rats, greater choice of delayed reward was associated with preserved working memory, impaired cognitive flexibility, and less motivation to work for food. These relationships suggest that age-related changes in PFC and incentive motivation contribute to variance in intertemporal choice within the aged population. Cognitive impairments mediated by PFC are unlikely, however, to fully account for the enhanced ability to delay gratification that accompanies aging.

Basolateral Amygdala to Orbitofrontal Cortex Projections Enable Cue-Triggered Reward Expectations

To make an appropriate decision, one must anticipate potential future rewarding events, even when they are not readily observable. These expectations are generated by using observable information (e.g., stimuli or available actions) to retrieve often quite detailed memories of available rewards. The basolateral amygdala (BLA) and orbitofrontal cortex (OFC) are two reciprocally connected key nodes in the circuitry supporting such outcome-guided behaviors. But there is much unknown about the contribution of this circuit to decision making, and almost nothing known about the whether any contribution is via direct, monosynaptic projections, or the direction of information transfer. Therefore, here we used designer receptor-mediated inactivation of OFC→BLA or BLA→OFC projections to evaluate their respective contributions to outcome-guided behaviors in rats. Inactivation of BLA terminals in the OFC, but not OFC terminals in the BLA, disrupted the selective motivating influence of cue-triggered reward representations over reward-seeking decisions as assayed by Pavlovian-to-instrumental transfer. BLA→OFC projections were also required when a cued reward representation was used to modify Pavlovian conditional goal-approach responses according to the reward's current value. These projections were not necessary when actions were guided by reward expectations generated based on learned action-reward contingencies, or when rewards themselves, rather than stored memories, directed action. These data demonstrate that BLA→OFC projections enable the cue-triggered reward expectations that can motivate the execution of specific action plans and allow adaptive conditional responding.SIGNIFICANCE STATEMENT Deficits anticipating potential future rewarding events are associated with many psychiatric diseases. Presently, we know little about the neural circuits supporting such reward expectation. Here we show that basolateral amygdala to orbitofrontal cortex projections are required for expectations of specific available rewards to influence reward seeking and decision making. The necessity of these projections was limited to situations in which expectations were elicited by reward-predictive cues. These projections therefore facilitate adaptive behavior by enabling the orbitofrontal cortex to use environmental stimuli to generate expectations of potential future rewarding events.

Disorganized Amygdala Networks in Conduct-Disordered Juvenile Offenders With Callous-Unemotional Traits

BACKGROUND

The developmental trajectory of psychopathy seemingly begins early in life and includes the presence of callous-unemotional (CU) traits (e.g., deficient emotional reactivity, callousness) in conduct-disordered (CD) youth. Though subregion-specific anomalies in amygdala function have been suggested in CU pathophysiology among antisocial populations, system-level studies of CU traits have typically examined the amygdala as a unitary structure. Hence, nothing is yet known of how amygdala subregional network function may contribute to callous-unemotionality in severely antisocial people.

METHODS

We addressed this important issue by uniquely examining the intrinsic functional connectivity of basolateral amygdala (BLA) and centromedial amygdala (CMA) networks across three matched groups of juveniles: CD offenders with CU traits (CD/CU+; n = 25), CD offenders without CU traits (CD/CU-; n = 25), and healthy control subjects (n = 24). We additionally examined whether perturbed amygdala subregional connectivity coincides with altered volume and shape of the amygdaloid complex.

RESULTS

Relative to CD/CU- and healthy control youths, CD/CU+ youths showed abnormally increased BLA connectivity with a cluster that included both dorsal and ventral portions of the anterior cingulate and medial prefrontal cortices, along with posterior cingulate, sensory associative, and striatal regions. In contrast, compared with CD/CU- and healthy control youths, CD/CU+ youths showed diminished CMA connectivity with ventromedial/orbitofrontal regions. Critically, these connectivity changes coincided with local hypotrophy of BLA and CMA subregions (without being statistically correlated) and were associated to more severe CU symptoms.

CONCLUSIONS

These findings provide unique insights into a putative mechanism for perturbed attention-emotion interactions, which could bias salience processing and associative learning in youth with CD/CU+.

Motivational neural circuits underlying reinforcement learning

Reinforcement learning (RL) is the behavioral process of learning the values of actions and objects. Most models of RL assume that the dopaminergic prediction error signal drives plasticity in frontal-striatal circuits. The striatum then encodes value representations that drive decision processes. However, the amygdala has also been shown to play an important role in forming Pavlovian stimulus-outcome associations. These Pavlovian associations can drive motivated behavior via the amygdala projections to the ventral striatum or the ventral tegmental area. The amygdala may, therefore, play a central role in RL. Here we compare the contributions of the amygdala and the striatum to RL and show that both the amygdala and striatum learn and represent expected values in RL tasks. Furthermore, value representations in the striatum may be inherited, to some extent, from the amygdala. The striatum may, therefore, play less of a primary role in learning stimulus-outcome associations in RL than previously suggested.

Amygdala inputs to prefrontal cortex guide behavior amid conflicting cues of reward and punishment

Orchestrating appropriate behavioral responses in the face of competing signals that predict either rewards or threats in the environment is crucial for survival. The basolateral nucleus of the amygdala (BLA) and prelimbic (PL) medial prefrontal cortex have been implicated in reward-seeking and fear-related responses, but how information flows between these reciprocally connected structures to coordinate behavior is unknown. We recorded neuronal activity from the BLA and PL while rats performed a task wherein competing shock- and sucrose-predictive cues were simultaneously presented. The correlated firing primarily displayed a BLA→PL directionality during the shock-associated cue. Furthermore, BLA neurons optogenetically identified as projecting to PL more accurately predicted behavioral responses during competition than unidentified BLA neurons. Finally photostimulation of the BLA→PL projection increased freezing, whereas both chemogenetic and optogenetic inhibition reduced freezing. Therefore, the BLA→PL circuit is critical in governing the selection of behavioral responses in the face of competing signals.

Thalamic Regulation of Sucrose Seeking during Unexpected Reward Omission

The paraventricular nucleus of the thalamus (PVT) is thought to regulate behavioral responses under emotionally arousing conditions. Reward-associated cues activate PVT neurons; however, the specific PVT efferents regulating reward seeking remain elusive. Using a cued sucrose-seeking task, we manipulated PVT activity under two emotionally distinct conditions: (1) when reward was available during the cue as expected or (2) when reward was unexpectedly omitted during the cue. Pharmacological inactivation of the anterior PVT (aPVT), but not the posterior PVT, increased sucrose seeking only when reward was omitted. Consistent with this, photoactivation of aPVT neurons abolished sucrose seeking, and the firing of aPVT neurons differentiated reward availability. Photoinhibition of aPVT projections to the nucleus accumbens or to the amygdala increased or decreased, respectively, sucrose seeking only when reward was omitted. Our findings suggest that PVT bidirectionally modulates sucrose seeking under the negative (frustrative) conditions of reward omission.

GABA Cells in the Central Nucleus of the Amygdala Promote Cataplexy

Cataplexy is a hallmark of narcolepsy characterized by the sudden uncontrollable onset of muscle weakness or paralysis during wakefulness. It can occur spontaneously, but is typically triggered by positive emotions such as laughter. Although cataplexy was identified >130 years ago, its neural mechanism remains unclear. Here, we show that a newly identified GABA circuit within the central nucleus of the amygdala (CeA) promotes cataplexy. We used behavioral, electrophysiological, immunohistochemical, and chemogenetic strategies to target and manipulate CeA activity selectively in narcoleptic (orexin^-/-) mice to determine its functional role in controlling cataplexy. First, we show that chemogenetic activation of the entire CeA produces a marked increase in cataplexy attacks. Then, we show that GABA cells within the CeA are responsible for mediating this effect. To manipulate GABA cells specifically, we developed a new mouse line that enables genetic targeting of GABA cells in orexin^-/- mice. We found that chemogenetic activation of GABA CeA cells triggered a 253% increase in the number of cataplexy attacks without affecting their duration, suggesting that GABA cells play a functional role in initiating but not maintaining cataplexy. We show that GABA cell activation only promotes cataplexy attacks associated with emotionally rewarding stimuli, not those occurring spontaneously. However, we found that chemogenetic inhibition of GABA CeA cells does not prevent cataplexy, suggesting these cells are not required for initiating cataplexy attacks. Our results indicate that the CeA promotes cataplexy onset and that emotionally rewarding stimuli may trigger cataplexy by activating GABA cells in the CeA.SIGNIFICANCE STATEMENT Although cataplexy has been closely linked to positive emotions for >130 years, the neural circuitry that underlies this relationship is poorly understood. Recent work suggests that the amygdala, a brain area important for processing emotion, may be part of this circuit. This study provides the first functional evidence to implicate GABA cells in the amygdala as regulators of cataplexy triggered by positive emotions and identifies the amygdala as the brain region important more for gating the entrance into rather than the exit from cataplexy. We also generated a new mouse model for studying GABA neurons in narcoleptic mice, which could serve as a useful tool for studying the neurobiological underpinnings of narcolepsy.

Dissociable relations between amygdala subregional networks and psychopathy trait dimensions in conduct-disordered juvenile offenders

Psychopathy is a serious psychiatric phenomenon characterized by a pathological constellation of affective (e.g., callous, unemotional), interpersonal (e.g., manipulative, egocentric), and behavioral (e.g., impulsive, irresponsible) personality traits. Though amygdala subregional defects are suggested in psychopathy, the functionality and connectivity of different amygdala subnuclei is typically disregarded in neurocircuit-level analyses of psychopathic personality. Hence, little is known of how amygdala subregional networks may contribute to psychopathy and its underlying trait assemblies in severely antisocial people. We addressed this important issue by uniquely examining the intrinsic functional connectivity of basolateral (BLA) and centromedial (CMA) amygdala networks in relation to affective, interpersonal, and behavioral traits of psychopathy, in conduct-disordered juveniles with a history of serious delinquency (N = 50, mean age = 16.83 ± 1.32). As predicted, amygdalar connectivity profiles exhibited dissociable relations with different traits of psychopathy. Interpersonal psychopathic traits not only related to increased connectivity of BLA and CMA with a corticostriatal network formation accommodating reward processing, but also predicted stronger CMA connectivity with a network of cortical midline structures supporting sociocognitive processes. In contrast, affective psychopathic traits related to diminished CMA connectivity with a frontolimbic network serving salience processing and affective responding. Finally, behavioral psychopathic traits related to heightened BLA connectivity with a frontoparietal cluster implicated in regulatory executive functioning. We suggest that these trait-specific shifts in amygdalar connectivity could be particularly relevant to the psychopathic phenotype, as they may fuel a self-centered, emotionally cold, and behaviorally disinhibited profile. Hum Brain Mapp 37:4017-4033, 2016. © 2016 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Neural correlates of two different types of extinction learning in the amygdala central nucleus

Extinction is a fundamental form of memory updating in which one learns to stop expecting an event that no longer occurs. This learning ensues when one experiences a change in environmental contingencies, that is, when an expected outcome fails to occur (simple extinction), or when a novel inflated expectation of a double outcome (overexpectation) is in conflict with the real outcome, and is a process that has been linked to amygdala function. Here, we show that in rats, the same neuronal population in the amygdala central nucleus updates reward expectancies and behaviour in both types of extinction, and neural changes in one paradigm are reflected in the other. This work may have implications for the management of addiction and anxiety disorders that require treatments based on the outcome omission, and disorders such as obesity that could use overexpectation, but not omission strategies.

Nucleus Accumbens and Posterior Amygdala Mediate Cue-Triggered Alcohol Seeking and Suppress Behavior During the Omission of Alcohol-Predictive Cues

Neurobiological mechanisms that influence behavior in the presence of alcohol-associated stimuli involve processes that organize behavior during the presence of these cues, and separately, regulation of behavior in their absence. However, little is known about anatomical structures that might mediate this regulation. Here we examined nucleus accumbens shell (AcbSh) as a possible neural substrate mediating behavior modulation triggered by the presence and absence of alcohol-associated environmental cues and contexts. We also examined subregions of basal amygdala nuclei- rostral basolateral (BLA) and basal posterior (BAP)- as they provide a major source of glutamatergic input to the AcbSh. Animals were trained to associate an auditory conditioning stimulus with alcohol in a discriminative context and then subsequently tested for conditioned port-entries across contexts either previously associated or not associated with alcohol. We found that, on test to the alcohol cue alone, AcbSh inactivation prevented conditioned port-entries in contexts that either were associated with alcohol or were novel, while also increasing unconditioned port-entries during the intertrial intervals. When tested to alcohol-reinforced cues, AcbSh inactivation produced more cue-trial omissions and elevated unconditioned port-entries. Interestingly, BLA and BAP inactivation produced dissociable effects. BAP but not BLA increased unconditioned port-entries, while both manipulations prevented conditioned port-entries during the alcohol-cue. We conclude that AcbSh is necessary for modulating control over behavior otherwise guided by the presence of alcohol-predictive environmental stimuli and contexts. Moreover, this role may involve integration of functionally segregated inputs from rostral and posterior portions of basal amygdala nuclei.

Resolving the neural circuits of anxiety

Although anxiety disorders represent a major societal problem demanding new therapeutic targets, these efforts have languished in the absence of a mechanistic understanding of this subjective emotional state. While it is impossible to know with certainty the subjective experience of a rodent, rodent models hold promise in dissecting well-conserved limbic circuits. The application of modern approaches in neuroscience has already begun to unmask the neural circuit intricacies underlying anxiety by allowing direct examination of hypotheses drawn from existing psychological concepts. This information points toward an updated conceptual model for what neural circuit perturbations could give rise to pathological anxiety and thereby provides a roadmap for future therapeutic development.

Increased Basolateral Amygdala Pyramidal Cell Excitability May Contribute to the Anxiogenic Phenotype Induced by Chronic Early-Life Stress

Adolescence represents a particularly vulnerable period during which exposure to stressors can precipitate the onset of psychiatric disorders and addiction. The basolateral amygdala (BLA) plays an integral role in the pathophysiology of anxiety and addiction. Acute and chronic stress promote increases in BLA pyramidal cell firing, and decreasing BLA excitability alleviates anxiety measures in humans and rodents. Notably, the impact of early-life stress on the mechanisms that govern BLA excitability is unknown. To address this gap in our knowledge, we used a rodent model of chronic early-life stress that engenders robust and enduring increases in anxiety-like behaviors and ethanol intake and examined the impact of this model on the intrinsic excitability of BLA pyramidal cells. Adolescent social isolation was associated with a significant increase in the intrinsic excitability of BLA pyramidal cells and a blunting of the medium component of the afterhyperpolarization potential, a voltage signature of calcium-activated potassium (Kca) channel activity. Western blot analysis revealed reduced expression of small-conductance Kca (SK) channel protein in the BLA of socially isolated (SI) rats. Bath application of a positive SK channel modulator (1-EBIO) normalized firing in ex vivo recordings from SI rats, and in vivo intra-BLA 1-EBIO infusion reduced anxiety-like behaviors. These findings reveal that chronic adolescent stress impairs SK channel function, which contributes to an increase in BLA pyramidal cell excitability and highlights BLA SK channels as promising targets for the treatment of anxiety disorders and comorbid addiction.

SIGNIFICANCE STATEMENT

Although anxiety disorders and alcohol addiction frequently co-occur, the mechanisms that contribute to this comorbidity are poorly understood. Here, we used a rodent early-life stress model that leads to robust and longlasting increases in behaviors associated with elevated risk of anxiety disorders and addiction to identify novel neurobiological substrates that may underlie these behaviors. Our studies focused on the primary output neurons of the basolateral amygdala, a brain region that plays a key role in anxiety and addiction. We discovered that early-life stress decreases the activity of a specific class of potassium channels and increases the intrinsic excitability of BLA neurons and present evidence that enhancing the function of these channels normalizes BLA excitability and attenuates anxiety-like behaviors.

The basolateral amygdala in reward learning and addiction

Sophisticated behavioral paradigms partnered with the emergence of increasingly selective techniques to target the basolateral amygdala (BLA) have resulted in an enhanced understanding of the role of this nucleus in learning and using reward information. Due to the wide variety of behavioral approaches many questions remain on the circumscribed role of BLA in appetitive behavior. In this review, we integrate conclusions of BLA function in reward-related behavior using traditional interference techniques (lesion, pharmacological inactivation) with those using newer methodological approaches in experimental animals that allow in vivo manipulation of cell type-specific populations and neural recordings. Secondly, from a review of appetitive behavioral tasks in rodents and monkeys and recent computational models of reward procurement, we derive evidence for BLA as a neural integrator of reward value, history, and cost parameters. Taken together, BLA codes specific and temporally dynamic outcome representations in a distributed network to orchestrate adaptive responses. We provide evidence that experiences with opiates and psychostimulants alter these outcome representations in BLA, resulting in long-term modified action.

Basolateral amygdala rapid glutamate release encodes an outcome-specific representation vital for reward-predictive cues to selectively invigorate reward-seeking actions

Environmental stimuli have the ability to generate specific representations of the rewards they predict and in so doing alter the selection and performance of reward-seeking actions. The basolateral amygdala participates in this process, but precisely how is unknown. To rectify this, we monitored, in near-real time, basolateral amygdala glutamate concentration changes during a test of the ability of reward-predictive cues to influence reward-seeking actions (Pavlovian-instrumental transfer). Glutamate concentration was found to be transiently elevated around instrumental reward seeking. During the Pavlovian-instrumental transfer test these glutamate transients were time-locked to and correlated with only those actions invigorated by outcome-specific motivational information provided by the reward-predictive stimulus (i.e., actions earning the same specific outcome as predicted by the presented CS). In addition, basolateral amygdala AMPA, but not NMDA glutamate receptor inactivation abolished the selective excitatory influence of reward-predictive cues over reward seeking. These data support [corrected] the hypothesis that transient glutamate release in the BLA can encode the outcome-specific motivational information provided by reward-predictive stimuli.

Neural mechanisms regulating different forms of risk-related decision-making: Insights from animal models

Over the past 20 years there has been a growing interest in the neural underpinnings of cost/benefit decision-making. Recent studies with animal models have made considerable advances in our understanding of how different prefrontal, striatal, limbic and monoaminergic circuits interact to promote efficient risk/reward decision-making, and how dysfunction in these circuits underlies aberrant decision-making observed in numerous psychiatric disorders. This review will highlight recent findings from studies exploring these questions using a variety of behavioral assays, as well as molecular, pharmacological, neurophysiological, and translational approaches. We begin with a discussion of how neural systems related to decision subcomponents may interact to generate more complex decisions involving risk and uncertainty. This is followed by an overview of interactions between prefrontal-amygdala-dopamine and habenular circuits in regulating choice between certain and uncertain rewards and how different modes of dopamine transmission may contribute to these processes. These data will be compared with results from other studies investigating the contribution of some of these systems to guiding decision-making related to rewards vs. punishment. Lastly, we provide a brief summary of impairments in risk-related decision-making associated with psychiatric disorders, highlighting recent translational studies in laboratory animals.

Postsynaptic adenosine A2A receptors modulate intrinsic excitability of pyramidal cells in the rat basolateral amygdala

BACKGROUND

The basolateral amygdala plays a critical role in the etiology of anxiety disorders and addiction. Pyramidal neurons, the primary output cells of this region, display increased firing following exposure to stressors, and it is thought that this increase in excitability contributes to stress responsivity and the expression of anxiety-like behaviors. However, much remains unknown about the underlying mechanisms that regulate the intrinsic excitability of basolateral amygdala pyramidal neurons.

METHODS

Ex vivo gramicidin perforated patch recordings were conducted in current clamp mode where hyper- and depolarizing current steps were applied to basolateral amygdala pyramidal neurons to assess the effects of adenosine A(2A) receptor modulation on intrinsic excitability.

RESULTS

Activation of adenosine A(2A) receptors with the selective A(2A) receptor agonist CGS-21680 significantly increased the firing rate of basolateral amygdala pyramidal neurons in rat amygdala brain slices, likely via inhibition of the slow afterhyperpolarization potential. Both of these A(2A) receptor-mediated effects were blocked by preapplication of a selective A(2A) receptor antagonist (ZM-241385) or by intra-pipette infusion of a protein kinase A inhibitor, suggesting a postsynaptic locus of A(2A) receptors on basolateral amygdala pyramidal neurons. Interestingly, bath application of the A(2A) receptor antagonist alone significantly attenuated basolateral amygdala pyramidal cell firing, consistent with a role for tonic adenosine in the regulation of the intrinsic excitability of these neurons.

CONCLUSIONS

Collectively, these data suggest that adenosine, via activation of A(2A) receptors, may directly facilitate basolateral amygdala pyramidal cell output, providing a possible balance for the recently described inhibitory effects of adenosine A1 receptor activation on glutamatergic excitation of basolateral amygdala pyramidal cells.

From circuits to behaviour in the amygdala

The amygdala has long been associated with emotion and motivation, playing an essential part in processing both fearful and rewarding environmental stimuli. How can a single structure be crucial for such different functions? With recent technological advances that allow for causal investigations of specific neural circuit elements, we can now begin to map the complex anatomical connections of the amygdala onto behavioural function. Understanding how the amygdala contributes to a wide array of behaviours requires the study of distinct amygdala circuits.