Consideration of a unified model of amygdalar associative functions

Behavioral outputs and overlapping circuits between conditional fear and active avoidance

Aversive learning can produce a wide variety of defensive behavioral responses depending on the circumstances, ranging from reactive responses like freezing to proactive avoidance responses. While most of this initial learning is behaviorally supported by an expectancy of an aversive outcome and neurally supported by activity within the basolateral amygdala, activity in other brain regions become necessary for the execution of defensive strategies that emerge in other aversive learning paradigms such as active avoidance. Here, we review the neural circuits that support both reactive and proactive defensive behaviors that are motivated by aversive learning, and identify commonalities between the neural substrates of these distinct (and often exclusive) behavioral strategies.

Prolonged avoidance training exacerbates OCD-like behaviors in a rodent model

Obsessive-compulsive disorder (OCD) is characterized by compulsive behaviors that often resemble avoidance of perceived danger. OCD can be treated with exposure-with-response prevention (ERP) therapy in which patients are exposed to triggers but are encouraged to refrain from compulsions, to extinguish compulsive responses. The compulsions of OCD are strengthened by many repeated exposures to triggers, but little is known about the effects of extended repetition of avoidance behaviors on extinction. Here we assessed the extent to which overtraining of active avoidance affects subsequent extinction-with-response prevention (Ext-RP) as a rodent model of ERP, in which rats are extinguished to triggers, while the avoidance option is prevented. Male rats conditioned for 8d or 20d produced similar avoidance behavior to a tone paired with a shock, however, the 20d group showed a severe impairment of extinction during Ext-RP, as well as heightened anxiety. Furthermore, the majority of overtrained (20d) rats (75%) exhibited persistent avoidance following Ext-RP. In the 8d group, only a minority of rats (37%) exhibited persistent avoidance, and this was associated with elevated activity (c-Fos) in the prelimbic cortex and nucleus accumbens. In the 20d group, the minority of non-persistent rats (25%) showed elevated activity in the insular-orbital cortex and paraventricular thalamus. Lastly, extending the duration of Ext-RP prevented the deleterious effects of overtraining on extinction and avoidance. These rodent findings suggest that repeated expression of compulsion-like behaviors biases individuals toward persistent avoidance and alters avoidance circuits, thereby reducing the effectiveness of current extinction-based therapies.

Relationship of sensation seeking with the neural correlates of appetitive conditioning

Previous research has linked sensation seeking with a heightened risk for drug abuse and other risk-taking behavior. As appetitive conditioning presents a model for the etiology and maintenance of addictive behavior, investigating sensation seeking in a classical conditioning paradigm might elucidate possible pathways toward addiction within this model. Furthermore, the theoretical concept underlying sensation seeking proposes a negative relationship between reward processing and sensation seeking in only moderately arousing situations, which has been neglected by previous research.

This study aimed to investigate this inverse relationship in moderately stimulating situations entailing reward processing using functional magnetic resonance imaging. Subjects (N = 38) participated in a classical conditioning paradigm in which a neutral stimulus (CS+) was repeatedly paired with a monetary reward, while another neutral stimulus (CS−) was not.

Imaging results revealed a negative relationship between sensation seeking and neural responses in the insula, amygdala and nucleus accumbens during the early phase and in the dorsal anterior cingulate cortex during the late phase of conditioning. These findings suggest reduced reward learning and consequently diminished processing of outcome expectancy in appetitive conditioning in subjects with high sensation seeking scores. The results are discussed with respect to clinical implications.

Neural correlates of subjective CS/UCS association in appetitive conditioning

Explicit knowledge of conditioned stimulus (CS)/unconditioned stimulus (UCS) associations is proposed as important factor in classical conditioning. However, while previous studies have focused on its roles in fear conditioning, it has been neglected in the context of appetitive conditioning. The present functional magnetic resonance study aimed to investigate neural activation and functional connectivity linked to subjective CS/UCS association in appetitive conditioning. In total, 85 subjects participated in an appetitive acquisition procedure in which a neutral stimulus (CS+) was paired with a monetary reward, while another neutral stimulus (CS-) was never paired with the reward. Directly afterwards, subjective CS/UCS association was assessed by measuring the extent to which the CS+ was thought to be associated with the UCS compared to the CS-. Close relationships were established between subjective CS/UCS association and activations in the primary visual cortex (V1) during the early phase of conditioning and in the striatum during the late conditioning phase. In addition, we observed inverse relationships between subjective CS/UCS association and both V1/ventromedial prefrontal cortex (vmPFC) and striatal/vmPFC connectivity. The results suggest the involvement of decoupling vmPFC connectivity in reward learning in general and the roles of attentional processes in the formation of the subjective CS/UCS association during the early phase and reward prediction during the late phase of appetitive conditioning.

Altered reward learning and hippocampal connectivity following psychosocial stress

Acute stress has a profound influence on learning, as has been demonstrated in verbal learning or fear conditioning. However, its effect on appetitive conditioning is still unclear. Fear conditioning research suggests the possibility of overgeneralization of conditioning to the CS- under acute stress due to its effect on prefrontal and hippocampal processing. In this study, participants (N = 56 males) were subjected to the Trier Social Stress Test or a placebo version. After that, all participants underwent an appetitive conditioning paradigm in the fMRI, in which one neutral cue (CS+) was repeatedly paired with reward, while another (CS-) was not. Importantly, the stress-group revealed overgeneralization of conditioning to the CS- on the behavioral level. On the neural level, stressed participants showed increased connectivity between the hippocampus and amygdala, vACC, and OFC, which maintain specificity of conditioning and also showed reduced differential activation. The results indicate overgeneralization of appetitive conditioning promoted by maladaptive balancing of pattern separation and pattern completion in the hippocampus under acute stress and are discussed with respect to clinical implications.

Neural correlates of appetitive extinction in humans

Appetitive extinction receives attention as an important model for the treatment of psychiatric disorders. However, in humans, its underlying neural correlates remain unknown. To close this gap, we investigated appetitive acquisition and extinction with fMRI in a 2-day monetary incentive delay paradigm. During appetitive conditioning, one stimulus (CS+) was paired with monetary reward, while another stimulus (CS−) was never rewarded. Twenty-four hours later, subjects underwent extinction, in which neither CS was reinforced. Appetitive conditioning elicited stronger skin conductance responses to the CS+ as compared with the CS−. Regarding subjective ratings, the CS+ was rated more pleasant and arousing than the CS− after conditioning. Furthermore, fMRI-results (CS+ − CS−) showed activation of the reward circuitry including amygdala, midbrain and striatal areas. During extinction, conditioned responses were successfully extinguished. In the early phase of extinction, we found a significant activation of the caudate, the hippocampus, the dorsal and ventral anterior cingulate cortex (dACC and vACC). In the late phase, we found significant activation of the nucleus accumbens (NAcc) and the amygdala. Correlational analyses with subjective ratings linked extinction success to the vACC and the NAcc, while associating the dACC with reduced extinction. The results reveal neural correlates of appetitive extinction in humans and extend assumptions from models for human extinction learning.

The birth, death and resurrection of avoidance: a reconceptualization of a troubled paradigm

Research on avoidance conditioning began in the late 1930s as a way to use laboratory experiments to better understand uncontrollable fear and anxiety. Avoidance was initially conceived of as a two-factor learning process in which fear is first acquired through Pavlovian aversive conditioning (so-called fear conditioning), and then behaviors that reduce the fear aroused by the Pavlovian conditioned stimulus are reinforced through instrumental conditioning. Over the years, criticisms of both the avoidance paradigm and the two-factor fear theory arose. By the mid-1980s, avoidance had fallen out of favor as an experimental model relevant to fear and anxiety. However, recent progress in understanding the neural basis of Pavlovian conditioning has stimulated a new wave of research on avoidance. This new work has fostered new insights into contributions of not only Pavlovian and instrumental learning but also habit learning, to avoidance, and has suggested that the reinforcing event underlying the instrumental phase should be conceived in terms of cellular and molecular events in specific circuits rather than in terms of vague notions of fear reduction. In our approach, defensive reactions (freezing), actions (avoidance) and habits (habitual avoidance) are viewed as being controlled by unique circuits that operate nonconsciously in the control of behavior, and that are distinct from the circuits that give rise to conscious feelings of fear and anxiety. These refinements, we suggest, overcome older criticisms, justifying the value of the new wave of research on avoidance, and offering a fresh perspective on the clinical implications of this work.

The Neural Foundations of Reaction and Action in Aversive Motivation

Much of the early research in aversive learning concerned motivation and reinforcement in avoidance conditioning and related paradigms. When the field transitioned toward the focus on Pavlovian threat conditioning in isolation, this paved the way for the clear understanding of the psychological principles and neural and molecular mechanisms responsible for this type of learning and memory that has unfolded over recent decades. Currently, avoidance conditioning is being revisited, and with what has been learned about associative aversive learning, rapid progress is being made. We review, below, the literature on the neural substrates critical for learning in instrumental active avoidance tasks and conditioned aversive motivation.

Extending the amygdala in theories of threat processing

The central extended amygdala is an evolutionarily conserved set of interconnected brain regions that play an important role in threat processing to promote survival. Two core components of the central extended amygdala, the central nucleus of the amygdala (Ce) and the lateral bed nucleus of the stria terminalis (BST) are highly similar regions that serve complimentary roles by integrating fear- and anxiety-relevant information. Survival depends on the ability of the central extended amygdala to rapidly integrate and respond to threats that vary in their immediacy, proximity, and characteristics. Future studies will benefit from understanding alterations in central extended amygdala function in relation to stress-related psychopathology.

The influence of acute stress on the regulation of conditioned fear

Fear learning and regulation is a prominent model for describing the pathogenesis of anxiety disorders and stress-related psychopathology. Fear expression can be modulated using a number of regulatory strategies, including extinction, cognitive emotion regulation, avoidance strategies and reconsolidation. In this review, we examine research investigating the effects of acute stress and stress hormones on these regulatory techniques. We focus on what is known about the impact of stress on the ability to flexibly regulate fear responses that are acquired through Pavlovian fear conditioning. Our primary aim is to explore the impact of stress on fear regulation in humans. Given this, we focus on techniques where stress has been linked to alterations of fear regulation in humans (extinction and emotion regulation), and briefly discuss other techniques (avoidance and reconsolidation) where the impact of stress or stress hormones have been mainly explored in animal models. These investigations reveal that acute stress may impair the persistent inhibition of fear, presumably by altering prefrontal cortex function. Characterizing the effects of stress on fear regulation is critical for understanding the boundaries within which existing regulation strategies are viable in everyday life and can better inform treatment options for those who suffer from anxiety and stress-related psychopathology.

Development of an aversive Pavlovian-to-instrumental transfer task in rat

Pavlovian-to-instrumental transfer (PIT) is an effect whereby a classically conditioned stimulus (CS) enhances ongoing instrumental responding. PIT has been extensively studied with appetitive conditioning but barely at all with aversive conditioning. Although it's been argued that conditioned suppression is a form of aversive PIT, this effect is fundamentally different from appetitive PIT because the CS suppresses, instead of facilitates, responding. Five experiments investigated the importance of a variety of factors on aversive PIT in a rodent Sidman avoidance paradigm in which ongoing shuttling behavior (unsignaled active avoidance or USAA) was facilitated by an aversive CS. Experiment 1 demonstrated a basic PIT effect. Experiment 2 found that a moderate amount of USAA extinction produces the strongest PIT with shuttling rates best at around 2 responses per minute prior to the CS. Experiment 3 tested a protocol in which the USAA behavior was required to reach the 2-response per minute mark in order to trigger the CS presentation and found that this produced robust and reliable PIT. Experiment 4 found that the Pavlovian conditioning US intensity was not a major determinant of PIT strength. Experiment 5 demonstrated that if the CS and US were not explicitly paired during Pavlovian conditioning, PIT did not occur, showing that CS-US learning is required. Together, these studies demonstrate a robust, reliable and stable aversive PIT effect that is amenable to analysis of neural circuitry.

Inactivation of the central nucleus of the amygdala blocks classical conditioning but not conditioning-specific reflex modification of rabbit heart rate

Heart rate (HR) conditioning in rabbits is a widely used model of classical conditioning of autonomic responding that is noted for being similar to the development of conditioned heart rate slowing (bradycardia) in humans. We have shown previously that in addition to HR changes to a tone conditioned stimulus (CS), the HR reflex itself can undergo associative change called conditioning-specific reflex modification (CRM) that manifests when tested in the absence of the CS. Because CRM resembles the conditioned bradycardic response to the CS, we sought to determine if HR conditioning and CRM share a common neural substrate. The central nucleus of the amygdala (CeA) is a critical part of the pathway through which conditioned bradycardia is established. To test whether the CeA is also involved in the acquisition and/or expression of CRM, we inactivated the CeA with muscimol during HR conditioning or CRM testing. CeA inactivation blocked HR conditioning without completely preventing CRM acquisition or expression. These results suggest that the CeA may therefore only play a modulatory role in CRM. Theories on the biological significance of conditioned bradycardia suggest that it may represent a state of hypervigilance that facilitates the detection of new and changing contingencies in the environment. We relate these ideas to our results and discuss how they may be relevant to the hypersensitivity observed in fear conditioning disorders like post-traumatic stress.

What and when to "want"? Amygdala-based focusing of incentive salience upon sugar and sex

RATIONALE

Amygdala-related circuitry helps translate learned Pavlovian associations into appetitive and aversive motivation, especially upon subsequent encounters with cues.

OBJECTIVES

We asked whether μ-opioid stimulation via microinjections of the specific agonist D-Ala(2), N-MePhe(4), Gly-ol)-enkephalin (DAMGO) in central nucleus of amygdala (CeA), or the adjacent basolateral amygdala (BLA) would magnify sucrose or sex "wanting", guided by available cues.

MATERIALS AND METHODS

CeA or BLA DAMGO enhancement of cue-triggered "wanting" was assessed using Pavlovian to instrumental transfer (PIT). Unconditioned food "wanting" was measured via intake, and male sexual "wanting" for an estrous female was measured in a sexual approach test. Sucrose hedonic taste "liking" was measured in a taste reactivity test.

RESULTS

CeA (but not BLA) DAMGO increased the intensity of phasic peaks in instrumental sucrose seeking stimulated by Pavlovian cues over precue levels in PIT, while suppressing seeking at other moments. CeA DAMGO also enhanced food intake, as well as sexual approach and investigation of an estrous female by males. DAMGO "wanting" enhancements were localized to CeA, as indicated by "Fos plume"-based anatomical maps for DAMGO causation of behavioral effects. Despite increasing "wanting", CeA DAMGO decreased the hedonic impact or "liking" for sucrose in a taste reactivity paradigm.

CONCLUSIONS

CeA μ-opioid stimulation specifically enhances incentive salience, which is dynamically guided to food or sex by available cues.

The role of amygdala nuclei in the expression of auditory signaled two-way active avoidance in rats

Using a two-way signaled active avoidance (2-AA) learning procedure, where rats were trained in a shuttle box to avoid a footshock signaled by an auditory stimulus, we tested the contributions of the lateral (LA), basal (B), and central (CE) nuclei of the amygdala to the expression of instrumental active avoidance conditioned responses (CRs). Discrete or combined lesions of the LA and B, performed after the rats had reached an asymptotic level of avoidance performance, produced deficits in the CR, whereas CE lesions had minimal effect. Fiber-sparing excitotoxic lesions of the LA/B produced by infusions of N-methyl-d-aspartate (NMDA) also impaired avoidance performance, confirming that neurons in the LA/B are involved in mediating avoidance CRs. In a final series of experiments, bilateral electrolytic lesions of the CE were performed on a subgroup of animals that failed to acquire the avoidance CR after 3 d of training. CE lesions led to an immediate rescue of avoidance learning, suggesting that activity in CE was inhibiting the instrumental CR. Taken together, these results indicate that the LA and B are essential for the performance of a 2-AA response. The CE is not required, and may in fact constrain the instrumental avoidance response by mediating the generation of competing Pavlovian responses, such as freezing.

Changing fear: the neurocircuitry of emotion regulation

The ability to alter emotional responses as circumstances change is a critical component of normal adaptive behavior and is often impaired in psychological disorders. In this review, we discuss four emotional regulation techniques that have been investigated as means to control fear: extinction, cognitive regulation, active coping, and reconsolidation. For each technique, we review what is known about the underlying neural systems, combining findings from animal models and human neuroscience. The current evidence suggests that these different means of regulating fear depend on both overlapping and distinct components of a fear circuitry.

Carbon dioxide induces erratic respiratory responses in bipolar disorder

BACKGROUND

CO(2) respiration stimulates both anxiety and dyspnea ("air hunger") and has long been used to study panic vulnerability and respiratory control. High comorbidity with panic attacks suggests individuals with bipolar disorder may also mount a heightened anxiety response to CO(2). Moreover, problems in the arousal and modulation of appetites are central to the clinical syndromes of mania and depression; hence CO(2) may arouse an abnormal respiratory response to "air hunger".

METHODS

72 individuals (34 bipolar I, 25 depressive and bipolar spectrum, 13 with no major affective diagnosis) breathed air and air with 5% CO(2) via facemask for up to 15 min each; subjective and respiratory responses were recorded.

RESULTS

Nearly half the subjects diverged from the typical response to a fixed, mildly hypercapneic environment, which is to increase breathing acutely, and then maintain a hyperpneic plateau. The best predictors of an abnormal pattern were bipolar diagnosis and anxiety from air alone. 25 individuals had a panic response; panic responses from CO(2) were more likely in subjects with bipolar I compared to other subjects, however the best predictors of a panic response overall were anxiety from air alone and prior history of panic attacks.

LIMITATIONS

Heterogeneous sample, liberal definition of panic attack.

CONCLUSION

Carbon dioxide produces abnormal respiratory and heightened anxiety responses among individuals with bipolar and depressive disorders. These may be due to deficits in emotional conditioning related to fear and appetite. Although preliminary, this work suggests a potentially useful test of a specific functional deficit in bipolar disorder.

Appetitive conditioning: neural bases and implications for psychopathology

Appetitive conditioning is the process through which new rewards are learned and acquire their motivational salience. Although it has the same evolutionary survival significance as aversive conditioning, appetitive conditioning has rarely been studied in humans. This gap may be explained by the difficulty to find in humans suitable appetitive stimuli that can elicit physiological responses similar to those elicited by aversive stimuli. To help remedy this gap, we review the literature on conditioning, with emphasis on appetitive conditioning. This review comprises three parts. First, we examine the different forms of conditioning. Second, we review the neural basis of appetitive conditioning, particularly from a functional neuroimaging perspective. And third, we demonstrate how perturbations in processes involved in appetitive conditioning can contribute to implicated psychopathologies and suggest neurobiological models underlying these pathologies. The ultimate goal of this review is to stimulate new avenues of research that have direct links to molecular biology, and thus could prove to be invaluable to progress in the understanding and treatment of psychiatric disabilities.

Panic comorbidity with bipolar disorder: what is the manic-panic connection?

CONTEXT

Bipolar/panic comorbidity has been observed in clinical, community and familial samples. As both are episodic disorders of affect regulation, the common pathophysiological mechanism is likely to involve deficits in amygdala-mediated, plasticity-dependent emotional conditioning.

EVIDENCE

Neuronal genesis and synaptic remodeling occur in the amygdala; bipolar and panic disorders have both been associated with abnormality in the amygdala and related structures, as well as in molecules that modulate plasticity, such as serotonin, norepinephrine, brain-derived neurotrophic factor (BDNF) and corticotrophin releasing factor (CRF). These biological elements are involved in behavioral conditioning to threat and reward.

MODEL

Panic attacks resemble the normal acute fear response, but are abnormally dissociated from any relevant threat. Abnormal reward-seeking behavior is central to both manic and depressive syndromes. Appetites can be elevated or depressed; satisfaction of a drive may fail to condition future behavior. These dissociations may be the result of deficits in plasticity-dependent processes of conditioning within different amygdala subregions.

CONCLUSIONS

This speculative model may be a useful framework with which to connect molecular, cellular, anatomic and behavioral processes in panic and bipolar disorders. The primary clinical implication is that behavioral treatment may be critical to restore function in some bipolar patients who respond only partially to medications.

Triadic model of the neurobiology of motivated behavior in adolescence

BACKGROUND

Risk-taking behavior is a major cause of morbidity and mortality in adolescence. In the context of decision theory and motivated (goal-directed) behavior, risk-taking reflects a pattern of decision-making that favors the selection of courses of action with uncertain and possibly harmful consequences. We present a triadic, neuroscience systems-based model of adolescent decision-making.

METHOD

We review the functional role and neurodevelopmental findings of three key structures in the control of motivated behavior, i.e. amygdala, nucleus accumbens, and medial/ventral prefrontal cortex. We adopt a cognitive neuroscience approach to motivated behavior that uses a temporal fragmentation of a generic motivated action. Predictions about the relative contributions of the triadic nodes to the three stages of a motivated action during adolescence are proposed.

RESULTS

The propensity during adolescence for reward/novelty seeking in the face of uncertainty or potential harm might be explained by a strong reward system (nucleus accumbens), a weak harm-avoidant system (amygdala), and/or an inefficient supervisory system (medial/ventral prefrontal cortex). Perturbations in these systems may contribute to the expression of psychopathology, illustrated here with depression and anxiety.

CONCLUSIONS

A triadic model, integrated in a temporally organized map of motivated behavior, can provide a helpful framework that suggests specific hypotheses of neural bases of typical and atypical adolescent behavior.

Neurobiology of decision making: a selective review from a neurocognitive and clinical perspective

We present a temporal map of key processes that occur during decision making, which consists of three stages: 1) formation of preferences among options, 2) selection and execution of an action, and 3) experience or evaluation of an outcome. This framework can be used to integrate findings of traditional choice psychology, neuropsychology, brain lesion studies, and functional neuroimaging. Decision making is distributed across various brain centers, which are differentially active across these stages of decision making. This approach can be used to follow developmental trajectories of the different stages of decision making and to identify unique deficits associated with distinct psychiatric disorders.

Hippocampal and amygdalar involvement in discriminatory place learning

A conflict task was developed that simultaneously examines place aversion learning and fear-motivated context discrimination. The task superimposed Pavlovian discriminative fear conditioning on an appetitively motivated instrumental response (alternation). Rats were trained to alternate along a high-walled, diamond-shaped runway between two chambers for food. On half of the trials, a tone CS signaled the fact that a fixed section at the apex of the runway was electrified. Both the tone and the shock were turned on at the beginning of, and remained on for the duration of, each tone trial. A new trial was initiated at the time the animal entered the subsequent food chamber. Therefore, during a tone trial, in order to attain additional food reinforcement, the animal had to cross over the electrified region at the runway apex. Behavioral performance of rats with small lesions of the amygdala or dorsal hippocampus (DH) was compared with that of sham-operated controls. All groups displayed significant discriminative responding, hesitating more on tone trials while in areas of the runway adjacent to the shock region. Animals with lesions of the DH were similar to controls with respect to the tone-mediated discrimination, yet were delayed in the initial expression of a location-specific fear response. Conversely, amygdala lesions did not affect place learning; however, these animals were impaired in their suppression of the fear response following repeated unpaired trials.