1
|
Diehl MM, Moscarello JM, Trask S. Behavioral outputs and overlapping circuits between conditional fear and active avoidance. Neurobiol Learn Mem 2024; 213:107943. [PMID: 38821256 DOI: 10.1016/j.nlm.2024.107943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2024] [Revised: 05/19/2024] [Accepted: 05/27/2024] [Indexed: 06/02/2024]
Abstract
Aversive learning can produce a wide variety of defensive behavioral responses depending on the circumstances, ranging from reactive responses like freezing to proactive avoidance responses. While most of this initial learning is behaviorally supported by an expectancy of an aversive outcome and neurally supported by activity within the basolateral amygdala, activity in other brain regions become necessary for the execution of defensive strategies that emerge in other aversive learning paradigms such as active avoidance. Here, we review the neural circuits that support both reactive and proactive defensive behaviors that are motivated by aversive learning, and identify commonalities between the neural substrates of these distinct (and often exclusive) behavioral strategies.
Collapse
Affiliation(s)
- Maria M Diehl
- Department of Psychological Sciences, Kansas State University, Manhattan, KS, USA
| | | | - Sydney Trask
- Department of Psychological Sciences, Purdue University, West Lafayette, IN, USA; Purdue Institute for Integrative Neuroscience, West Lafayette, IN, USA.
| |
Collapse
|
2
|
Sears RM, Andrade EC, Samels SB, Laughlin LC, Moloney DM, Wilson DA, Alwood MR, Moscarello JM, Cain CK. Devaluation of response-produced safety signals reveals circuits for goal-directed versus habitual avoidance in dorsal striatum. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.07.579321. [PMID: 38370659 PMCID: PMC10871355 DOI: 10.1101/2024.02.07.579321] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Active avoidance responses (ARs) are instrumental behaviors that prevent harm. Adaptive ARs may contribute to active coping, whereas maladaptive avoidance habits are implicated in anxiety and obsessive-compulsive disorders. The AR learning mechanism has remained elusive, as successful avoidance trials produce no obvious reinforcer. We used a novel outcome-devaluation procedure in rats to show that ARs are positively reinforced by response-produced feedback (FB) cues that develop into safety signals during training. Males were sensitive to FB-devaluation after moderate training, but not overtraining, consistent with a transition from goal-directed to habitual avoidance. Using chemogenetics and FB-devaluation, we also show that goal-directed vs. habitual ARs depend on dorsomedial vs. dorsolateral striatum, suggesting a significant overlap between the mechanisms of avoidance and rewarded instrumental behavior. Females were insensitive to FB-devaluation due to a remarkable context-dependence of counterconditioning. However, degrading the AR-FB contingency suggests that both sexes rely on safety signals to perform goal-directed ARs.
Collapse
Affiliation(s)
- Robert M Sears
- Department of Child & Adolescent Psychiatry, NYU Grossman School of Medicine, 1 Park Avenue, 8 Floor, New York, NY 10016
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962
- These authors contributed equally
| | - Erika C Andrade
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962
- These authors contributed equally
| | - Shanna B Samels
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962
| | - Lindsay C Laughlin
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962
| | - Danielle M Moloney
- Department of Child & Adolescent Psychiatry, NYU Grossman School of Medicine, 1 Park Avenue, 8 Floor, New York, NY 10016
| | - Donald A Wilson
- Department of Child & Adolescent Psychiatry, NYU Grossman School of Medicine, 1 Park Avenue, 8 Floor, New York, NY 10016
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962
| | - Matthew R Alwood
- Department of Psychological & Brain Sciences, Texas A&M Institute for Neuroscience, Texas A&M University, 301 Old Main, TAMU MS 3474, College Station, TX 77843-3474
| | - Justin M Moscarello
- Department of Psychological & Brain Sciences, Texas A&M Institute for Neuroscience, Texas A&M University, 301 Old Main, TAMU MS 3474, College Station, TX 77843-3474
| | - Christopher K Cain
- Department of Child & Adolescent Psychiatry, NYU Grossman School of Medicine, 1 Park Avenue, 8 Floor, New York, NY 10016
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962
| |
Collapse
|
3
|
Habit Formation and the Effect of Repeated Stress Exposures on Cognitive Flexibility Learning in Horses. Animals (Basel) 2022; 12:ani12202818. [DOI: 10.3390/ani12202818] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Revised: 10/13/2022] [Accepted: 10/13/2022] [Indexed: 11/16/2022] Open
Abstract
Horse training exposes horses to an array of cognitive and ethological challenges. Horses are routinely required to perform behaviours that are not aligned to aspects of their ethology, which may delay learning. While horses readily form habits during training, not all of these responses are considered desirable, resulting in the horse being subject to retraining. This is a form of cognitive flexibility and is critical to the extinction of habits and the learning of new responses. It is underpinned by complex neural processes which can be impaired by chronic or repeated stress. Domestic horses may be repeatedly exposed to multiples stressors. The potential contribution of stress impairments of cognitive flexibility to apparent training failures is not well understood, however research from neuroscience can be used to understand horses’ responses to training. We trained horses to acquire habit-like responses in one of two industry-style aversive instrumental learning scenarios (moving away from the stimulus-instinctual or moving towards the stimulus-non-instinctual) and evaluated the effect of repeated stress exposures on their cognitive flexibility in a reversal task. We measured heart rate as a proxy for noradrenaline release, salivary cortisol and serum Brain Derived Neurotrophic Factor (BDNF) to infer possible neural correlates of the learning outcomes. The instinctual task which aligned with innate equine escape responses to aversive stimuli was acquired significantly faster than the non-instinctual task during both learning phases, however contrary to expectations, the repeated stress exposure did not impair the reversal learning. We report a preliminary finding that serum BDNF and salivary cortisol concentrations in horses are positively correlated. The ethological salience of training tasks and cognitive flexibility learning can significantly affect learning in horses and trainers should adapt their practices where such tasks challenge innate equine behaviour.
Collapse
|
4
|
Ma J, du Hoffmann J, Kindel M, Beas BS, Chudasama Y, Penzo MA. Divergent projections of the paraventricular nucleus of the thalamus mediate the selection of passive and active defensive behaviors. Nat Neurosci 2021; 24:1429-1440. [PMID: 34413514 PMCID: PMC8484052 DOI: 10.1038/s41593-021-00912-7] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2021] [Accepted: 07/15/2021] [Indexed: 11/13/2022]
Abstract
The appropriate selection of passive and active defensive behaviors in threatening situations is essential for survival. Previous studies have shown that passive defensive responses depend on activity of the central nucleus of the amygdala (CeA), whereas active ones primarily rely on the nucleus accumbens (NAc). However, the mechanisms underlying flexible switching between these two types of responses remain unknown. Here, we show in mice that the paraventricular thalamus (PVT) mediates the selection of defensive behaviors through its interaction with the CeA and the NAc. We show that the PVT–CeA pathway drives conditioned freezing responses, whereas the PVT–NAc pathway is inhibited during freezing and instead signals active avoidance events. Optogenetic manipulations revealed that activity in the PVT–CeA or PVT–NAc pathway biases behavior toward the selection of passive or active defensive responses, respectively. These findings provide evidence that the PVT mediates flexible switching between opposing defensive behaviors.
Collapse
Affiliation(s)
- Jun Ma
- Unit on the Neurobiology of Affective Memory, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| | - Johann du Hoffmann
- Central Nervous System Diseases Research, Boehringer Ingelheim Pharma GmbH & Co. KG, Biberach an der Riß, Germany.,Rodent Behavioral Core, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| | - Morgan Kindel
- Unit on the Neurobiology of Affective Memory, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| | - B Sofia Beas
- Unit on the Neurobiology of Affective Memory, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| | - Yogita Chudasama
- Rodent Behavioral Core, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA.,Section on Behavioral Neuroscience, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| | - Mario A Penzo
- Unit on the Neurobiology of Affective Memory, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA.
| |
Collapse
|
5
|
Campese VD. The lesser evil: Pavlovian-instrumental transfer & aversive motivation. Behav Brain Res 2021; 412:113431. [PMID: 34175357 DOI: 10.1016/j.bbr.2021.113431] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2021] [Revised: 06/13/2021] [Accepted: 06/22/2021] [Indexed: 01/01/2023]
Abstract
While our understanding of appetitive motivation includes accounts of rich cognitive phenomena, such as choice, sensory-specificity and outcome valuation, the same is not true in aversive processes. A highly sophisticated picture has emerged of Pavlovian fear conditioning and extinction, but progress in aversive motivation has been somewhat limited to these fundamental behaviors. Many differences between appetitive and aversive stimuli permit different kinds of analyses; a widely used procedure in appetitive studies that can expand the scope of aversive motivation is Pavlovian-instrumental transfer (PIT). Recently, this motivational transfer effect has been used to examine issues pertaining to sensory-specificity and the nature of defensive control in avoidance learning. Given enduring controversies and unresolved criticisms surrounding avoidance research, PIT offers a valuable, well-controlled procedure with which to similarly probe this form of motivation. Furthermore, while avoidance itself can be criticized as artificial, PIT can be an effective model for how skills learned through avoidance can be practically applied to encounters with threatening or fearful stimuli and stress. Despite sensory-related challenges presented by the limited aversive unconditioned stimuli typically used in research, transfer testing can nevertheless provide valuable information on the psychological nature of this historically controversial phenomenon.
Collapse
|
6
|
Imaging of Functional Brain Circuits during Acquisition and Memory Retrieval in an Aversive Feedback Learning Task: Single Photon Emission Computed Tomography of Regional Cerebral Blood Flow in Freely Behaving Rats. Brain Sci 2021; 11:brainsci11050659. [PMID: 34070079 PMCID: PMC8158148 DOI: 10.3390/brainsci11050659] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Revised: 05/05/2021] [Accepted: 05/08/2021] [Indexed: 11/30/2022] Open
Abstract
Active avoidance learning is a complex form of aversive feedback learning that in humans and other animals is essential for actively coping with unpleasant, aversive, or dangerous situations. Since the functional circuits involved in two-way avoidance (TWA) learning have not yet been entirely identified, the aim of this study was to obtain an overall picture of the brain circuits that are involved in active avoidance learning. In order to obtain a longitudinal assessment of activation patterns in the brain of freely behaving rats during different stages of learning, we applied single-photon emission computed tomography (SPECT). We were able to identify distinct prefrontal cortical, sensory, and limbic circuits that were specifically recruited during the acquisition and retrieval phases of the two-way avoidance learning task.
Collapse
|
7
|
Manning EE, Bradfield LA, Iordanova MD. Adaptive behaviour under conflict: Deconstructing extinction, reversal, and active avoidance learning. Neurosci Biobehav Rev 2020; 120:526-536. [PMID: 33035525 DOI: 10.1016/j.neubiorev.2020.09.030] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Revised: 09/28/2020] [Accepted: 09/30/2020] [Indexed: 12/23/2022]
Abstract
In complex environments, organisms must respond adaptively to situations despite conflicting information. Under natural (i.e. non-laboratory) circumstances, it is rare that cues or responses are consistently paired with a single outcome. Inconsistent pairings are more common, as are situations where cues and responses are associated with multiple outcomes. Such inconsistency creates conflict, and a response that is adaptive in one scenario may not be adaptive in another. Learning to adjust responses accordingly is important for species to survive and prosper. Here we review the behavioural and brain mechanisms of responding under conflict by focusing on three popular behavioural procedures: extinction, reversal learning, and active avoidance. Extinction involves adapting from reinforcement to non-reinforcement, reversal learning involves swapping the reinforcement of cues or responses, and active avoidance involves performing a response to avoid an aversive outcome, which may conflict with other defensive strategies. We note that each of these phenomena relies on somewhat overlapping neural circuits, suggesting that such circuits may be critical for the general ability to respond appropriately under conflict.
Collapse
Affiliation(s)
- Elizabeth E Manning
- Department of Psychiatry, University of Pittsburgh, Suite 223, 450 Technology Drive, Pittsburgh, PA, 15224, USA; School of Biomedical Sciences and Pharmacy, University of Newcastle, MS306, University Drive, Callaghan, NSW, 2308, Australia.
| | - Laura A Bradfield
- Centre for Neuroscience and Regenerative Medicine, University of Technology Sydney (St. Vincent's Campus), 405 Liverpool St, Darlinghurst, NSW, 2010, Australia; St. Vincent's Centre for Applied Medical Research, St. Vincent's Hospital Sydney Limited, 405 Liverpool St, Darlinghurst, NSW, 2010, Australia.
| | - Mihaela D Iordanova
- Department of Psychology/Centre for Studies in Behavioural Neurobiology, Concordia University, Montreal, Canada.
| |
Collapse
|
8
|
Martínez-Rivera FJ, Sánchez-Navarro MJ, Huertas-Pérez CI, Greenberg BD, Rasmussen SA, Quirk GJ. Prolonged avoidance training exacerbates OCD-like behaviors in a rodent model. Transl Psychiatry 2020; 10:212. [PMID: 32620740 PMCID: PMC7334221 DOI: 10.1038/s41398-020-00892-5] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/07/2019] [Revised: 06/05/2020] [Accepted: 06/10/2020] [Indexed: 01/12/2023] Open
Abstract
Obsessive-compulsive disorder (OCD) is characterized by compulsive behaviors that often resemble avoidance of perceived danger. OCD can be treated with exposure-with-response prevention (ERP) therapy in which patients are exposed to triggers but are encouraged to refrain from compulsions, to extinguish compulsive responses. The compulsions of OCD are strengthened by many repeated exposures to triggers, but little is known about the effects of extended repetition of avoidance behaviors on extinction. Here we assessed the extent to which overtraining of active avoidance affects subsequent extinction-with-response prevention (Ext-RP) as a rodent model of ERP, in which rats are extinguished to triggers, while the avoidance option is prevented. Male rats conditioned for 8d or 20d produced similar avoidance behavior to a tone paired with a shock, however, the 20d group showed a severe impairment of extinction during Ext-RP, as well as heightened anxiety. Furthermore, the majority of overtrained (20d) rats (75%) exhibited persistent avoidance following Ext-RP. In the 8d group, only a minority of rats (37%) exhibited persistent avoidance, and this was associated with elevated activity (c-Fos) in the prelimbic cortex and nucleus accumbens. In the 20d group, the minority of non-persistent rats (25%) showed elevated activity in the insular-orbital cortex and paraventricular thalamus. Lastly, extending the duration of Ext-RP prevented the deleterious effects of overtraining on extinction and avoidance. These rodent findings suggest that repeated expression of compulsion-like behaviors biases individuals toward persistent avoidance and alters avoidance circuits, thereby reducing the effectiveness of current extinction-based therapies.
Collapse
Affiliation(s)
- Freddyson J Martínez-Rivera
- Departments of Psychiatry and Anatomy & Neurobiology, School of Medicine, Medical Sciences Campus, University of Puerto Rico, San Juan, PR, 00936, USA.
- Nash family Department of Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USA.
| | - Marcos J Sánchez-Navarro
- Departments of Psychiatry and Anatomy & Neurobiology, School of Medicine, Medical Sciences Campus, University of Puerto Rico, San Juan, PR, 00936, USA
| | - Carlos I Huertas-Pérez
- Departments of Psychiatry and Anatomy & Neurobiology, School of Medicine, Medical Sciences Campus, University of Puerto Rico, San Juan, PR, 00936, USA
| | - Benjamin D Greenberg
- Department of Psychiatry and Human Behavior, Alpert Medical School of Brown University and Butler Hospital and the Providence VA Medical Center, Providence, RI, 02906, USA
| | - Steven A Rasmussen
- Department of Psychiatry and Human Behavior, Alpert Medical School of Brown University and Butler Hospital and the Providence VA Medical Center, Providence, RI, 02906, USA
| | - Gregory J Quirk
- Departments of Psychiatry and Anatomy & Neurobiology, School of Medicine, Medical Sciences Campus, University of Puerto Rico, San Juan, PR, 00936, USA
| |
Collapse
|
9
|
Geramita MA, Yttri EA, Ahmari SE. The two‐step task, avoidance, and OCD. J Neurosci Res 2020; 98:1007-1019. [DOI: 10.1002/jnr.24594] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2019] [Revised: 01/02/2020] [Accepted: 01/30/2020] [Indexed: 01/12/2023]
Affiliation(s)
- Matthew A. Geramita
- Department of Psychiatry University of Pittsburgh Pittsburgh PA USA
- Department of Biological Sciences Carnegie Mellon University Pittsburgh PA USA
- Center for Neural Basis of Cognition University of Pittsburgh Pittsburgh PA USA
| | - Eric A. Yttri
- Department of Biological Sciences Carnegie Mellon University Pittsburgh PA USA
- Center for Neural Basis of Cognition University of Pittsburgh Pittsburgh PA USA
| | - Susanne E. Ahmari
- Department of Psychiatry University of Pittsburgh Pittsburgh PA USA
- Center for Neural Basis of Cognition University of Pittsburgh Pittsburgh PA USA
| |
Collapse
|
10
|
Diehl MM, Bravo-Rivera C, Quirk GJ. The study of active avoidance: A platform for discussion. Neurosci Biobehav Rev 2019; 107:229-237. [PMID: 31509767 PMCID: PMC6936221 DOI: 10.1016/j.neubiorev.2019.09.010] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2019] [Revised: 07/19/2019] [Accepted: 09/06/2019] [Indexed: 11/27/2022]
Abstract
Traditional active avoidance tasks have advanced the field of aversive learning and memory for decades and are useful for studying simple avoidance responses in isolation; however, these tasks have limited clinical relevance because they do not model several key features of clinical avoidance. In contrast, platform-mediated avoidance (PMA) more closely resembles clinical avoidance because the response i) is associated with an unambiguous safe location, ii) is not associated with an artificial termination of the warning signal, and iii) is associated with a decision-based appetitive cost. Recent findings on the neuronal circuits of PMA have confirmed that amygdala-striatal circuits are essential for avoidance. In PMA, however, the prelimbic cortex facilitates the avoidance response early during the warning signal, perhaps through disinhibition of the striatum. Future studies on avoidance should account for additional factors such as sex differences and social interactions that will advance our understanding of maladaptive avoidance contributing to neuropsychiatric disorders.
Collapse
Affiliation(s)
- Maria M Diehl
- Departments of Psychiatry and Anatomy & Neurobiology, University of Puerto Rico School of Medicine, San Juan, PR, 00936, Puerto Rico; Department of Psychological Sciences, Kansas State University, Manhattan, KS, 66506 United States
| | | | - Gregory J Quirk
- Departments of Psychiatry and Anatomy & Neurobiology, University of Puerto Rico School of Medicine, San Juan, PR, 00936, Puerto Rico.
| |
Collapse
|
11
|
Thibeault KC, Kutlu MG, Sanders C, Calipari ES. Cell-type and projection-specific dopaminergic encoding of aversive stimuli in addiction. Brain Res 2019; 1713:1-15. [PMID: 30580012 PMCID: PMC6506354 DOI: 10.1016/j.brainres.2018.12.024] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2018] [Revised: 11/26/2018] [Accepted: 12/16/2018] [Indexed: 01/02/2023]
Abstract
Drug addiction is a major public health concern across the world for which there are limited treatment options. In order to develop new therapies to correct the behavioral deficits that result from repeated drug use, we need to understand the neural circuit dysfunction that underlies the pathophysiology of the disorder. Because the initial reinforcing effects of drugs are dependent on increases in dopamine in reward-related brain regions such as the mesolimbic dopamine pathway, a large focus of addiction research has centered on the dysregulation of this system and its control of positive reinforcement and motivation. However, in addition to the processing of positive, rewarding stimuli, there are clear deficits in the encoding and valuation of information about potential negative outcomes and how they control decision making and motivation. Further, aversive stimuli can motivate or suppress behavior depending on the context in which they are encountered. We propose a model where rewarding and aversive information guides the execution of specific motivated actions through mesocortical and mesolimbic dopamine acting on D1- and D2- receptor containing neuronal populations. Volitional drug exposure alters the processing of rewarding and aversive stimuli through remodeling of these dopaminergic circuits, causing maladaptive drug seeking, self-administration in the face of negative consequences, and drug craving. Together, this review discusses the dysfunction of the circuits controlling different types of aversive learning as well as how these guide specific discrete behaviors, and provides a conceptual framework for how they should be considered in preclinical addiction models.
Collapse
Affiliation(s)
- Kimberly C Thibeault
- Vanderbilt Center for Addiction Research, Vanderbilt University School of Medicine, Nashville, TN 37232, USA; Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232, USA
| | - Munir Gunes Kutlu
- Department of Pharmacology, Vanderbilt University School of Medicine, Nashville, TN 37232, USA
| | - Christina Sanders
- Department of Pharmacology, Vanderbilt University School of Medicine, Nashville, TN 37232, USA
| | - Erin S Calipari
- Department of Pharmacology, Vanderbilt University School of Medicine, Nashville, TN 37232, USA; Vanderbilt Center for Addiction Research, Vanderbilt University School of Medicine, Nashville, TN 37232, USA; Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232, USA.
| |
Collapse
|
12
|
The power of price compels you: Behavioral economic insights into dopamine-based valuation of rewarding and aversively motivated behavior. Brain Res 2018; 1713:32-41. [PMID: 30543771 DOI: 10.1016/j.brainres.2018.11.043] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2018] [Revised: 11/26/2018] [Accepted: 11/29/2018] [Indexed: 01/02/2023]
Abstract
The mesocorticolimbic dopamine pathway is generally considered to be a reward pathway. While shortsighted, there is a strong basis for this view of dopamine function. Here, we first describe the role of phasic dopamine release events in reward seeking. We then explain why these release events are being reconsidered as value signals and how we applied behavioral economics to confirm they play a causal role in the valuation of reward. Just because dopamine release can function as a dopamine reward value signal however, does not imply that dopamine is solely a reward molecule. Rather, mesocorticolimbic dopamine appears to mediate many adaptive behaviors, including: reward seeking, avoidance, escape and fear-associated conditioned freezing. While more studies are needed before a consensus is reached on when, where and how dopamine mediates aversively-motivated behavior, its involvement is almost irrefutable. Thus, we next describe the role dopamine plays in these ethologically-relevant defensive behaviors. We conclude by describing our recent behavioral economics results that reveal a causal role for dopamine in the valuation of avoidance.
Collapse
|
13
|
Burhans LB, Schreurs BG. Inactivation of the interpositus nucleus blocks the acquisition of conditioned responses and timing changes in conditioning-specific reflex modification of the rabbit eyeblink response. Neurobiol Learn Mem 2018; 155:143-156. [PMID: 30053576 PMCID: PMC6731038 DOI: 10.1016/j.nlm.2018.07.008] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2018] [Revised: 07/20/2018] [Accepted: 07/23/2018] [Indexed: 01/08/2023]
Abstract
Conditioning-specific reflex modification (CRM) of the rabbit eyeblink response is an associative phenomenon characterized by increases in the frequency, size, and peak latency of the reflexive unconditioned eyeblink response (UR) when the periorbital shock unconditioned stimulus (US) is presented alone following conditioning, particularly to lower intensity USs that produced minimal responding prior to conditioning. Previous work has shown that CRM shares many commonalities with the conditioned eyeblink response (CR) including a similar response topography, suggesting the two may share similar neural substrates. The following study examined the hypothesis that the interpositus nucleus (IP) of the cerebellum, an essential part of the neural circuitry of eyeblink conditioning, is also required for the acquisition of CRM. Tests for CRM occurred following delay conditioning under muscimol inactivation of the IP and also after additional conditioning without IP inactivation. Results showed that IP inactivation blocked acquisition of CRs and the timing aspect of CRM but did not prevent increases in UR amplitude and area. Following the cessation of inactivation, CRs and CRM latency changes developed similarly to controls with intact IP functioning, but with some indication that CRs may have been facilitated in muscimol rabbits. In conclusion, CRM timing and CRs both likely require the development of plasticity in the IP, but other associative UR changes may involve non-cerebellar structures interacting with the eyeblink conditioning circuitry, a strong candidate being the amygdala, which is also likely involved in the facilitation of conditioning. Other candidates worth consideration include the cerebellar cortex, prefrontal and motor cortices.
Collapse
Affiliation(s)
- Lauren B Burhans
- Rockefeller Neuroscience Institute and Department of Physiology and Pharmacology, West Virginia University, Morgantown, WV, USA.
| | - Bernard G Schreurs
- Rockefeller Neuroscience Institute and Department of Physiology and Pharmacology, West Virginia University, Morgantown, WV, USA
| |
Collapse
|
14
|
Abstract
Active avoidance is the prototypical paradigm for studying aversively-motivated instrumental behavior. However, avoidance research stalled amid heated theoretical debates and the hypothesis that active avoidance is essentially Pavlovian flight. Here I reconsider key "avoidance problems" and review neurobehavioral data collected with modern tools. Although the picture remains incomplete, these studies strongly suggest that avoidance has an instrumental component and is mediated by brain circuits that resemble appetitive instrumental actions more than Pavlovian fear reactions. Rapid progress may be possible if investigators consider important factors like safety signals, response-competition, goal-directed vs. habitual control and threat imminence in avoidance study design. Since avoidance responses likely contribute to active coping, this research has important implications for understanding human resilience and disorders of control.
Collapse
Affiliation(s)
- Christopher K Cain
- NYU School of Medicine, Dept. of Child & Adolescent Psychiatry, 1 Park Avenue, 8 Floor, New York, NY 10016.,Nathan S. Kline Institute for Psychiatric Research, Emotional Brain Institute, 140 Old Orangeburg Road, Orangeburg, NY 10962
| |
Collapse
|
15
|
LeDoux J, Daw ND. Surviving threats: neural circuit and computational implications of a new taxonomy of defensive behaviour. Nat Rev Neurosci 2018; 19:269-282. [PMID: 29593300 DOI: 10.1038/nrn.2018.22] [Citation(s) in RCA: 190] [Impact Index Per Article: 31.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Research on defensive behaviour in mammals has in recent years focused on elicited reactions; however, organisms also make active choices when responding to danger. We propose a hierarchical taxonomy of defensive behaviour on the basis of known psychological processes. Included are three categories of reactions (reflexes, fixed reactions and habits) and three categories of goal-directed actions (direct action-outcome behaviours and actions based on implicit or explicit forecasting of outcomes). We then use this taxonomy to guide a summary of findings regarding the underlying neural circuits.
Collapse
Affiliation(s)
- Joseph LeDoux
- Center for Neural Science and Department of Psychology, New York University, New York, NY, USA.,Department of Psychiatry and Department of Child and Adolescent Psychiatry, New York University Langone Medical School, New York, NY, USA.,Nathan Kline Institute for Psychiatry Research, Orangeburg, NY, USA
| | - Nathaniel D Daw
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| |
Collapse
|
16
|
Spiegler KM, Fortress AM, Pang KCH. Differential use of danger and safety signals in an animal model of anxiety vulnerability: The behavioral economics of avoidance. Prog Neuropsychopharmacol Biol Psychiatry 2018; 82:195-204. [PMID: 29175308 DOI: 10.1016/j.pnpbp.2017.11.015] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/26/2017] [Revised: 11/08/2017] [Accepted: 11/18/2017] [Indexed: 11/28/2022]
Abstract
Differential processing of danger and safety signals may underlie symptoms of anxiety disorders and posttraumatic stress disorder. One symptom common to these disorders is pathological avoidance. The present study examined whether danger and safety signals influence avoidance differently in anxiety-vulnerable Wistar-Kyoto (WKY) rats and Sprague Dawley (SD) rats. SD and WKY rats were tested in a novel progressive ratio avoidance task with and without danger or safety signals. Two components of reinforcement, hedonic value and motivation, were determined by fitting an exponentiated demand equation to the data. Hedonic value of avoidance did not differ between SD and WKY rats, but WKY rats had greater motivation to avoid than SD rats. Removal of the safety signal reduced motivation to avoid in SD, but not WKY, rats. Removal of the danger signal did not alter avoidance in either strain. When danger and safety signals were presented simultaneously, WKY rats responded to the danger signals, whereas SD rats responded to the safety signal. The results provide evidence that 1) safety signals enhance motivation to avoid in SD rats, 2) both danger and safety signals influence motivation in WKY rats, and 3) danger signals take precedence over safety signals when presented simultaneously in WKY rats. Thus, anxiety vulnerability is associated with preferential use of danger signals to motivate avoidance. The differential use of danger and safety signals has important implications for the etiology and treatment of pathological avoidance in anxiety disorders and posttraumatic stress disorder.
Collapse
Affiliation(s)
- Kevin M Spiegler
- Graduate School of Biomedical Sciences, Rutgers Biomedical and Health Sciences, Newark, NJ, United States
| | - Ashley M Fortress
- NeuroBehavioral Research Laboratory, Department of Veterans Affairs, New Jersey Health Care System, East Orange, NJ, United States
| | - Kevin C H Pang
- NeuroBehavioral Research Laboratory, Department of Veterans Affairs, New Jersey Health Care System, East Orange, NJ, United States; Graduate School of Biomedical Sciences, Rutgers Biomedical and Health Sciences, Newark, NJ, United States; Department of Pharmacology, Physiology and Neuroscience, New Jersey Medical School, Rutgers Biomedical and Health Science, United States.
| |
Collapse
|
17
|
Moscarello JM, Maren S. Flexibility in the face of fear: Hippocampal-prefrontal regulation of fear and avoidance. Curr Opin Behav Sci 2017; 19:44-49. [PMID: 29333482 DOI: 10.1016/j.cobeha.2017.09.010] [Citation(s) in RCA: 43] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Generating appropriate defensive behaviors in the face of threat is essential to survival. Although many of these behaviors are 'hard-wired', they are also flexible. For example, Pavlovian fear conditioning generates learned defensive responses, such as conditioned freezing, that can be suppressed through extinction. The expression of extinguished responses is highly context-dependent, allowing animals to engage behavioral responses appropriate to the contexts in which threats are encountered. Likewise, animals and humans will avoid noxious outcomes if given the opportunity. In instrumental avoidance learning, for example, animals overcome conditioned defensive responses, including freezing, in order to actively avoid aversive stimuli. Recent work has greatly advanced understanding of the neural basis of these phenomena and has revealed common circuits involved in the regulation of fear. Specifically, the hippocampus and medial prefrontal cortex play pivotal roles in gating fear reactions and instrumental actions, mediated by the amygdala and nucleus accumbens, respectively. Because an inability to adaptively regulate fear and defensive behavior is a central component of many anxiety disorders, the brain circuits that promote flexible responses to threat are of great clinical significance.
Collapse
Affiliation(s)
- Justin M Moscarello
- Department of Psychology and Institute for Neuroscience, Texas A&M University
| | - Stephen Maren
- Department of Psychology and Institute for Neuroscience, Texas A&M University
| |
Collapse
|
18
|
LeDoux JE, Moscarello J, Sears R, Campese V. The birth, death and resurrection of avoidance: a reconceptualization of a troubled paradigm. Mol Psychiatry 2017; 22:24-36. [PMID: 27752080 PMCID: PMC5173426 DOI: 10.1038/mp.2016.166] [Citation(s) in RCA: 206] [Impact Index Per Article: 29.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/22/2016] [Revised: 08/03/2016] [Accepted: 08/11/2016] [Indexed: 12/28/2022]
Abstract
Research on avoidance conditioning began in the late 1930s as a way to use laboratory experiments to better understand uncontrollable fear and anxiety. Avoidance was initially conceived of as a two-factor learning process in which fear is first acquired through Pavlovian aversive conditioning (so-called fear conditioning), and then behaviors that reduce the fear aroused by the Pavlovian conditioned stimulus are reinforced through instrumental conditioning. Over the years, criticisms of both the avoidance paradigm and the two-factor fear theory arose. By the mid-1980s, avoidance had fallen out of favor as an experimental model relevant to fear and anxiety. However, recent progress in understanding the neural basis of Pavlovian conditioning has stimulated a new wave of research on avoidance. This new work has fostered new insights into contributions of not only Pavlovian and instrumental learning but also habit learning, to avoidance, and has suggested that the reinforcing event underlying the instrumental phase should be conceived in terms of cellular and molecular events in specific circuits rather than in terms of vague notions of fear reduction. In our approach, defensive reactions (freezing), actions (avoidance) and habits (habitual avoidance) are viewed as being controlled by unique circuits that operate nonconsciously in the control of behavior, and that are distinct from the circuits that give rise to conscious feelings of fear and anxiety. These refinements, we suggest, overcome older criticisms, justifying the value of the new wave of research on avoidance, and offering a fresh perspective on the clinical implications of this work.
Collapse
Affiliation(s)
- J E LeDoux
- Center for Neural Science, New York University, New York, NY, USA
- Nathan Kline Institute, Orangeburg, NY, USA
| | - J Moscarello
- Center for Neural Science, New York University, New York, NY, USA
| | - R Sears
- Center for Neural Science, New York University, New York, NY, USA
| | - V Campese
- Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
19
|
Campese VD, Sears RM, Moscarello JM, Diaz-Mataix L, Cain CK, LeDoux JE. The Neural Foundations of Reaction and Action in Aversive Motivation. Curr Top Behav Neurosci 2016; 27:171-195. [PMID: 26643998 DOI: 10.1007/7854_2015_401] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Much of the early research in aversive learning concerned motivation and reinforcement in avoidance conditioning and related paradigms. When the field transitioned toward the focus on Pavlovian threat conditioning in isolation, this paved the way for the clear understanding of the psychological principles and neural and molecular mechanisms responsible for this type of learning and memory that has unfolded over recent decades. Currently, avoidance conditioning is being revisited, and with what has been learned about associative aversive learning, rapid progress is being made. We review, below, the literature on the neural substrates critical for learning in instrumental active avoidance tasks and conditioned aversive motivation.
Collapse
Affiliation(s)
| | - Robert M Sears
- Emotional Brain Institute at NYU and Nathan Kline Institute, New York, USA
| | | | | | - Christopher K Cain
- Emotional Brain Institute at NYU and Nathan Kline Institute, New York, USA
| | - Joseph E LeDoux
- Center for Neural Science, NYU, New York, USA
- Emotional Brain Institute at NYU and Nathan Kline Institute, New York, USA
| |
Collapse
|
20
|
Kim E, Kim EJ, Yeh R, Shin M, Bobman J, Krasne FB, Kim JJ. Amygdaloid and non-amygdaloid fear both influence avoidance of risky foraging in hungry rats. Proc Biol Sci 2015; 281:rspb.2013.3357. [PMID: 25056616 DOI: 10.1098/rspb.2013.3357] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023] Open
Abstract
Considerable evidence seems to show that emotional and reflex reactions to feared situations are mediated by the amygdala. It might therefore seem plausible to expect that amygdala-coded fear should also influence decisions when animals make choices about instrumental actions. However, there is not good evidence of this. In particular, it appears, though the literature is conflicted, that once learning is complete, the amygdala may often not be involved in instrumental avoidance behaviours. It is therefore of interest that we have found in rats living for extended periods in a semi-naturalistic 'closed economy', where they were given random shocks in regions that had to be entered to obtain food, choices about feeding behaviour were in fact influenced by amygdala-coded fear, in spite of the null effect of amygdalar lesions on fear of dangerous location per se. We suggest that avoidance of highly motivated voluntary behaviour does depend in part on fear signals originating in the amygdala. Such signalling may be one role of well-known projections from amygdala to cortico-striate circuitry.
Collapse
Affiliation(s)
- Earnest Kim
- Department of Psychology, University of Washington, Seattle, WA 98195-1525, USA
| | - Eun Joo Kim
- Department of Psychology, University of Washington, Seattle, WA 98195-1525, USA
| | - Regina Yeh
- Department of Psychology, University of Washington, Seattle, WA 98195-1525, USA
| | - Minkyung Shin
- Department of Psychology, University of Washington, Seattle, WA 98195-1525, USA
| | - Jake Bobman
- Department of Psychology, University of Washington, Seattle, WA 98195-1525, USA
| | - Franklin B Krasne
- Department of Psychology, University of California, Los Angeles, CA 90095-1563, USA
| | - Jeansok J Kim
- Department of Psychology, University of Washington, Seattle, WA 98195-1525, USA Program in Neurobiology and Behavior, University of Washington, Seattle, WA 98195-1525, USA
| |
Collapse
|
21
|
Ilango A, Shumake J, Wetzel W, Ohl FW. Contribution of emotional and motivational neurocircuitry to cue-signaled active avoidance learning. Front Behav Neurosci 2014; 8:372. [PMID: 25386127 PMCID: PMC4209857 DOI: 10.3389/fnbeh.2014.00372] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2014] [Accepted: 10/08/2014] [Indexed: 12/25/2022] Open
Affiliation(s)
- Anton Ilango
- Leibniz Institute for Neurobiology , Magdeburg , Germany
| | - Jason Shumake
- Department of Psychology, The University of Texas , Austin , USA
| | - Wolfram Wetzel
- Leibniz Institute for Neurobiology , Magdeburg , Germany
| | - Frank W Ohl
- Leibniz Institute for Neurobiology , Magdeburg , Germany ; Institute of Biology, University of Magdeburg , Magdeburg , Germany ; Center for Behavioral Brain Sciences (CBBS) , Magdeburg , Germany
| |
Collapse
|
22
|
McCue MG, LeDoux JE, Cain CK. Medial amygdala lesions selectively block aversive pavlovian-instrumental transfer in rats. Front Behav Neurosci 2014; 8:329. [PMID: 25278858 PMCID: PMC4166994 DOI: 10.3389/fnbeh.2014.00329] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2014] [Accepted: 09/03/2014] [Indexed: 11/13/2022] Open
Abstract
Pavlovian conditioned stimuli (CSs) play an important role in the reinforcement and motivation of instrumental active avoidance (AA). Conditioned threats can also invigorate ongoing AA responding [aversive Pavlovian-instrumental transfer (PIT)]. The neural circuits mediating AA are poorly understood, although lesion studies suggest that lateral, basal, and central amygdala nuclei, as well as infralimbic prefrontal cortex, make key, and sometimes opposing, contributions. We recently completed an extensive analysis of brain c-Fos expression in good vs. poor avoiders following an AA test (Martinez et al., 2013, Learning and Memory). This analysis identified medial amygdala (MeA) as a potentially important region for Pavlovian motivation of instrumental actions. MeA is known to mediate defensive responding to innate threats as well as social behaviors, but its role in mediating aversive Pavlovian-instrumental interactions is unknown. We evaluated the effect of MeA lesions on Pavlovian conditioning, Sidman two-way AA conditioning (shuttling) and aversive PIT in rats. Mild footshocks served as the unconditioned stimulus in all conditioning phases. MeA lesions had no effect on AA but blocked the expression of aversive PIT and 22 kHz ultrasonic vocalizations in the AA context. Interestingly, MeA lesions failed to affect Pavlovian freezing to discrete threats but reduced freezing to contextual threats when assessed outside of the AA chamber. These findings differentiate MeA from lateral and central amygdala, as lesions of these nuclei disrupt Pavlovian freezing and aversive PIT, but have opposite effects on AA performance. Taken together, these results suggest that MeA plays a selective role in the motivation of instrumental avoidance by general or uncertain Pavlovian threats.
Collapse
Affiliation(s)
- Margaret G McCue
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research , Orangeburg, NY , USA
| | - Joseph E LeDoux
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research , Orangeburg, NY , USA ; Center for Neural Science, New York University , New York, NY , USA
| | - Christopher K Cain
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research , Orangeburg, NY , USA ; Child and Adolescent Psychiatry, New York University Medical School , New York, NY , USA
| |
Collapse
|
23
|
Campese VD, Kim J, Lázaro-Muñoz G, Pena L, LeDoux JE, Cain CK. Lesions of lateral or central amygdala abolish aversive Pavlovian-to-instrumental transfer in rats. Front Behav Neurosci 2014; 8:161. [PMID: 24847229 PMCID: PMC4019882 DOI: 10.3389/fnbeh.2014.00161] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2014] [Accepted: 04/16/2014] [Indexed: 11/25/2022] Open
Abstract
Aversive Pavlovian conditioned stimuli (CSs) elicit defensive reactions (e.g., freezing) and motivate instrumental actions like active avoidance (AA). Pavlovian reactions require connections between the lateral (LA) and central (CeA) nuclei of the amygdala, whereas AA depends on LA and basal amygdala (BA). Thus, the neural circuits mediating conditioned reactions and motivation appear to diverge in the amygdala. However, AA is not ideal for studying conditioned motivation, because Pavlovian and instrumental learning are intermixed. Pavlovian-to-instrumental transfer (PIT) allows for the study of conditioned motivation in isolation. PIT refers to the ability of a Pavlovian CS to modulate a separately-trained instrumental action. The role of the amygdala in aversive PIT is unknown. We designed an aversive PIT procedure in rats and tested the effects of LA, BA, and CeA lesions. Rats received Pavlovian tone-shock pairings followed by Sidman shock-avoidance training. PIT was assessed by comparing shuttling rates in the presence and absence of the tone. Tone presentations facilitated instrumental responding. Aversive PIT was abolished by lesions of LA or CeA, but was unaffected by lesions of BA. These results suggest that LA and CeA are essential for aversive conditioned motivation. More specifically, the results are consistent with a model of amygdala processing in which the CS is encoded in the LA and then, via connections to CeA, the motivation to perform the aversive task is enhanced. These findings have implications for understanding the contribution of amygdala circuits to aversive instrumental motivation, but also for the relation of aversive and appetitive behavioral control.
Collapse
Affiliation(s)
| | - Jeanny Kim
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research Orangeburg, NY, USA
| | | | - Lashawn Pena
- Center for Neural Science, New York University New York, NY, USA ; Department of Psychology, Hunter College, CUNY New York, NY, USA
| | - Joseph E LeDoux
- Center for Neural Science, New York University New York, NY, USA ; Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research Orangeburg, NY, USA
| | - Christopher K Cain
- Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research Orangeburg, NY, USA ; Child and Adolescent Psychiatry, New York University School of Medicine New York, NY, USA
| |
Collapse
|
24
|
Martinez RCR, Gupta N, Lázaro-Muñoz G, Sears RM, Kim S, Moscarello JM, LeDoux JE, Cain CK. Active vs. reactive threat responding is associated with differential c-Fos expression in specific regions of amygdala and prefrontal cortex. Learn Mem 2013; 20:446-52. [PMID: 23869027 PMCID: PMC3718200 DOI: 10.1101/lm.031047.113] [Citation(s) in RCA: 66] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Active avoidance (AA) is an important paradigm for studying mechanisms of aversive instrumental learning, pathological anxiety, and active coping. Unfortunately, AA neurocircuits are poorly understood, partly because behavior is highly variable and reflects a competition between Pavlovian reactions and instrumental actions. Here we exploited the behavioral differences between good and poor avoiders to elucidate the AA neurocircuit. Rats received Sidman AA training and expression of the activity-dependent immediate-early gene c-fos was measured after a shock-free AA test. Six brain regions with known or putative roles in AA were evaluated: amygdala, periaqueductal gray, nucleus accumbens, dorsal striatum, prefrontal cortex (PFC), and hippocampus. Good avoiders showed little Pavlovian freezing and high AA rates at test, the opposite of poor avoiders. Although c-Fos activation was observed throughout the brain, differential activation was found only in subregions of amygdala and PFC. Interestingly, c-Fos correlated with avoidance and freezing in only five of 20 distinct areas evaluated: lateral amygdala, central amygdala, medial amygdala, basal amygdala, and infralimbic PFC. Thus, activity in specific amygdala–PFC circuits likely mediates the competition between instrumental actions and Pavlovian reactions after AA training. Individual differences in AA behavior, long considered a nuisance by researchers, may be the key to elucidating the AA neurocircuit and understanding pathological response profiles.
Collapse
Affiliation(s)
- Raquel C R Martinez
- University of Sao Paulo, Medical School, Surgery Department LIM 26 HCFMUSP, Sao Paulo 01246-903, Brazil
| | | | | | | | | | | | | | | |
Collapse
|
25
|
Burhans LB, Schreurs BG. Inactivation of the central nucleus of the amygdala blocks classical conditioning but not conditioning-specific reflex modification of rabbit heart rate. Neurobiol Learn Mem 2012; 100:88-97. [PMID: 23266790 DOI: 10.1016/j.nlm.2012.12.011] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2012] [Revised: 12/04/2012] [Accepted: 12/16/2012] [Indexed: 11/16/2022]
Abstract
Heart rate (HR) conditioning in rabbits is a widely used model of classical conditioning of autonomic responding that is noted for being similar to the development of conditioned heart rate slowing (bradycardia) in humans. We have shown previously that in addition to HR changes to a tone conditioned stimulus (CS), the HR reflex itself can undergo associative change called conditioning-specific reflex modification (CRM) that manifests when tested in the absence of the CS. Because CRM resembles the conditioned bradycardic response to the CS, we sought to determine if HR conditioning and CRM share a common neural substrate. The central nucleus of the amygdala (CeA) is a critical part of the pathway through which conditioned bradycardia is established. To test whether the CeA is also involved in the acquisition and/or expression of CRM, we inactivated the CeA with muscimol during HR conditioning or CRM testing. CeA inactivation blocked HR conditioning without completely preventing CRM acquisition or expression. These results suggest that the CeA may therefore only play a modulatory role in CRM. Theories on the biological significance of conditioned bradycardia suggest that it may represent a state of hypervigilance that facilitates the detection of new and changing contingencies in the environment. We relate these ideas to our results and discuss how they may be relevant to the hypersensitivity observed in fear conditioning disorders like post-traumatic stress.
Collapse
Affiliation(s)
- Lauren B Burhans
- Blanchette Rockefeller Neurosciences Institute, Department of Physiology and Pharmacology, West Virginia University, Morgantown, WV, USA.
| | | |
Collapse
|
26
|
Schlund MW, Magee S, Hudgins CD. Human avoidance and approach learning: evidence for overlapping neural systems and experiential avoidance modulation of avoidance neurocircuitry. Behav Brain Res 2011; 225:437-48. [PMID: 21840340 DOI: 10.1016/j.bbr.2011.07.054] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2011] [Revised: 07/22/2011] [Accepted: 07/28/2011] [Indexed: 10/17/2022]
Abstract
Adaptive functioning is thought to reflect a balance between approach and avoidance neural systems with imbalances often producing pathological forms of avoidance. Yet little evidence is available in healthy adults demonstrating a balance between approach and avoidance neural systems and modulation in avoidance neurocircuitry by vulnerability factors for avoidance. Consequently, we used functional magnetic resonance imaging (fMRI) to compare changes in brain activation associated with human avoidance and approach learning and modulation of avoidance neurocircuitry by experiential avoidance. fMRI tracked trial-by-trial increases in activation while adults learned through trial and error an avoidance response that prevented money loss and an approach response that produced money gain. Avoidance and approach cues elicited similar experience-dependent increases in activation in a fronto-limbic-striatal network. Positive and negative reinforcing outcomes (i.e., money gain and avoidance of loss) also elicited similar increases in activation in frontal and striatal regions. Finally, increased experiential avoidance and self-punishment coping was associated with decreased activation in medial/superior frontal regions, anterior cingulate, amygdala and hippocampus. These findings suggest avoidance and approach learning recruit a similar fronto-limbic-striatal network in healthy adults. Increased experiential avoidance also appears to be associated with reduced frontal and limbic reactivity in avoidance, establishing an important link between maladaptive avoidance coping and altered responses in avoidance neurocircuitry.
Collapse
Affiliation(s)
- Michael W Schlund
- Department of Behavior Analysis, University of North Texas, Denton TX, PO Box 310919, Denton, TX 76203, USA.
| | | | | |
Collapse
|
27
|
Lázaro-Muñoz G, LeDoux JE, Cain CK. Sidman instrumental avoidance initially depends on lateral and basal amygdala and is constrained by central amygdala-mediated Pavlovian processes. Biol Psychiatry 2010; 67:1120-7. [PMID: 20110085 PMCID: PMC3085029 DOI: 10.1016/j.biopsych.2009.12.002] [Citation(s) in RCA: 98] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/04/2009] [Revised: 12/01/2009] [Accepted: 12/01/2009] [Indexed: 11/19/2022]
Abstract
BACKGROUND The lateral (LA) and central (CE), but not basal (B), amygdala nuclei are necessary for reactive Pavlovian fear responses such as freezing. The amygdala also plays a key role in the acquisition and expression of active instrumental defensive behaviors, but little is known about the specific roles of amygdala nuclei. Using a Sidman active avoidance (AA) task, we examined the necessity of LA, B, and CE for learning and performance. Pavlovian freezing was simultaneously assessed to examine the contributions of amygdala nuclei to the transition from reactive to active defensive responding. METHODS Rats received electrolytic lesions of LA, CE, or B before AA training, or following overtraining. Rats that expressed low levels of AA performance during training received bilateral electrolytic lesions to CE to eliminate competing freezing reactions and rescue AA. AA performance and freezing were assessed. RESULTS Damage to LA and B, but not CE, impaired the acquisition of AA. Performance of AA became amygdala-independent following overtraining. CE lesions abolished Pavlovian freezing and rescued instrumental AA performance in rats that expressed low levels of avoidance responses and high levels of freezing during training. CONCLUSIONS Although the acquisition of Pavlovian fear depends on LA and CE, but not B, acquisition of instrumental AA is dependent on LA and B, but not CE. CE-dependent Pavlovian processes that control freezing can constrain avoidance behavior. Performance of well-trained AA becomes independent of all three amygdala nuclei. Thus, it appears that different output pathways of LA mediate reactive and active conditioned defensive responding.
Collapse
Affiliation(s)
- Gabriel Lázaro-Muñoz
- W.M. Keck Foundation Laboratory of Neurobiology, Center for Neural Science, New York University, New York, NY 10003, USA
| | - Joseph E. LeDoux
- W.M. Keck Foundation Laboratory of Neurobiology, Center for Neural Science, New York University, New York, NY 10003, USA
- Department of Psychology, New York University, New York, NY 10003, USA
- Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY 10962, USA
- Emotional Brain Institute, New York University, New York, NY 10003, USA
| | - Christopher K. Cain
- W.M. Keck Foundation Laboratory of Neurobiology, Center for Neural Science, New York University, New York, NY 10003, USA
- Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY 10962, USA
- Emotional Brain Institute, New York University, New York, NY 10003, USA
| |
Collapse
|
28
|
Choi JS, Cain CK, LeDoux JE. The role of amygdala nuclei in the expression of auditory signaled two-way active avoidance in rats. Learn Mem 2010; 17:139-47. [PMID: 20189958 DOI: 10.1101/lm.1676610] [Citation(s) in RCA: 131] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Using a two-way signaled active avoidance (2-AA) learning procedure, where rats were trained in a shuttle box to avoid a footshock signaled by an auditory stimulus, we tested the contributions of the lateral (LA), basal (B), and central (CE) nuclei of the amygdala to the expression of instrumental active avoidance conditioned responses (CRs). Discrete or combined lesions of the LA and B, performed after the rats had reached an asymptotic level of avoidance performance, produced deficits in the CR, whereas CE lesions had minimal effect. Fiber-sparing excitotoxic lesions of the LA/B produced by infusions of N-methyl-d-aspartate (NMDA) also impaired avoidance performance, confirming that neurons in the LA/B are involved in mediating avoidance CRs. In a final series of experiments, bilateral electrolytic lesions of the CE were performed on a subgroup of animals that failed to acquire the avoidance CR after 3 d of training. CE lesions led to an immediate rescue of avoidance learning, suggesting that activity in CE was inhibiting the instrumental CR. Taken together, these results indicate that the LA and B are essential for the performance of a 2-AA response. The CE is not required, and may in fact constrain the instrumental avoidance response by mediating the generation of competing Pavlovian responses, such as freezing.
Collapse
Affiliation(s)
- June-Seek Choi
- Center for Neural Science, New York University, New York, New York 10003, USA.
| | | | | |
Collapse
|
29
|
Plakke B, Freeman JH, Poremba A. Metabolic mapping of rat forebrain and midbrain during delay and trace eyeblink conditioning. Neurobiol Learn Mem 2009; 92:335-44. [PMID: 19376256 DOI: 10.1016/j.nlm.2009.04.001] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2008] [Revised: 04/03/2009] [Accepted: 04/07/2009] [Indexed: 11/28/2022]
Abstract
While the essential neural circuitry for delay eyeblink conditioning has been largely identified, much of the neural circuitry for trace conditioning has yet to be determined. The major difference between delay and trace conditioning is a time gap between the presentation of the conditioned stimulus (CS) and the unconditioned stimulus (US) during trace conditioning. It is this time gap, which accounts for the additional memory component and may require extra neural structures, including hippocampus and prefrontal cortex. A metabolic marker of energy use, radioactively labeled glucose analog, was used to compare differences in glucose analog uptake between delay, trace, and unpaired experimental groups (rats, Long-Evans), to identify possible new areas of involvement within forebrain and midbrain. Here, we identify increased 2-DG uptake for the delay group compared to the unpaired group in various areas including: the medial geniculate nuclei (MGN), the amygdala, cingulate cortex, auditory cortex, medial dorsal thalamus, and frontal cortices. For the trace group, compared to the unpaired group, there was an increase in 2-DG uptake for the medial orbital frontal cortex and the medial MGN. The trace group also exhibited more increases lateralized to the right hemisphere, opposite to the side of US delivery, in various areas including: CA1, subiculum, presubiculum, perirhinal cortex, ventral and dorsal MGN, and the basolateral and central amygdala. While some of these areas have been identified as important for delay or trace conditioning, some new structures have been identified such as the orbital frontal cortex for both delay and trace groups.
Collapse
Affiliation(s)
- Bethany Plakke
- University of Iowa, Department of Psychology, Iowa City, IA 52242, USA
| | | | | |
Collapse
|
30
|
Rapid avoidance acquisition in Wistar–Kyoto rats. Behav Brain Res 2008; 192:191-7. [DOI: 10.1016/j.bbr.2008.04.006] [Citation(s) in RCA: 78] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2007] [Revised: 04/01/2008] [Accepted: 04/09/2008] [Indexed: 12/21/2022]
|
31
|
Cain CK, LeDoux JE. Chapter 3.1 Brain mechanisms of Pavlovian and instrumental aversive conditioning. HANDBOOK OF ANXIETY AND FEAR 2008. [DOI: 10.1016/s1569-7339(07)00007-0] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
|
32
|
Moutoussis M, Bentall RP, Williams J, Dayan P. A temporal difference account of avoidance learning. NETWORK (BRISTOL, ENGLAND) 2008; 19:137-160. [PMID: 18569725 DOI: 10.1080/09548980802192784] [Citation(s) in RCA: 53] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/26/2023]
Abstract
Aversive processing plays a central role in human phobic fears and may also be important in some symptoms of psychosis. We developed a temporal-difference model of the conditioned avoidance response, an important experimental model for aversive learning which is also a central pharmacological model of psychosis. In the model, dopamine neurons reported outcomes that were better than the learner expected, typically coming from reaching safety states, and thus controlled the acquisition of a suitable policy. The model accounts for normal conditioned avoidance learning, the persistence of responding in extinction, and critical effects of dopamine blockade, notably that subjects experiencing shocks under dopamine blockade, and hence failing to avoid them, nevertheless develop avoidance responses when both shocks and dopamine blockade are subsequently removed. These postulated roles of dopamine in aversive learning can thus account for many of the effects of dopaminergic modulation seen in laboratory models of psychopathological processes.
Collapse
|
33
|
Bruchey AK, Gonzalez-Lima F. Enhanced metabolic capacity of the frontal cerebral cortex after Pavlovian conditioning. Neuroscience 2007; 152:299-307. [PMID: 18291593 DOI: 10.1016/j.neuroscience.2007.08.036] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2007] [Revised: 07/19/2007] [Accepted: 11/16/2007] [Indexed: 10/22/2022]
Abstract
While Pavlovian conditioning alters stimulus-evoked metabolic activity in the cerebral cortex, less is known about the effects of Pavlovian conditioning on neuronal metabolic capacity. Pavlovian conditioning may increase prefrontal cortical metabolic capacity, as suggested by evidence of changes in cortical synaptic strengths, and evidence for a shift in memory initially processed in subcortical regions to more distributed prefrontal cortical circuits. Quantitative cytochrome oxidase histochemistry was used to measure cumulative changes in brain metabolic capacity associated with both cued and contextual Pavlovian conditioning in rats. The cued conditioned group received tone-foot-shock pairings to elicit a conditioned freezing response to the tone conditioned stimulus, while the contextually conditioned group received pseudorandom tone-foot-shock pairings in an excitatory context. Untrained control group was handled daily, but did not receive any tone presentations or foot shocks. The cued conditioned group had higher cytochrome oxidase activity in the infralimbic and anterior cingulate cortex, and lower cytochrome oxidase activity in dorsal hippocampus than the other two groups. A significant increase in cytochrome oxidase activity was found in anterior cortical areas (medial, dorsal and lateral frontal cortex; agranular insular cortex; lateral and medial orbital cortex and prelimbic cortex) in both conditioned groups, as compared with the untrained control group. In addition, no differences in cytochrome oxidase activity in the somatosensory regions and the amygdala were detected among all groups. The findings indicate that cued and contextual Pavlovian conditioning induces sustained increases in frontal cortical neuronal metabolic demand resulting in regional enhancement in the metabolic capacity of anterior cortical regions. Enhanced metabolic capacity of these anterior cortical areas after Pavlovian conditioning suggests that the frontal cortex may play a role in the retention and regulation of learned associations.
Collapse
Affiliation(s)
- A K Bruchey
- Department of Psychology and Institute for Neuroscience, University of Texas, Austin, TX 78712-0187, USA
| | | |
Collapse
|
34
|
Knapska E, Radwanska K, Werka T, Kaczmarek L. Functional internal complexity of amygdala: focus on gene activity mapping after behavioral training and drugs of abuse. Physiol Rev 2007; 87:1113-73. [PMID: 17928582 DOI: 10.1152/physrev.00037.2006] [Citation(s) in RCA: 105] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The amygdala is a heterogeneous brain structure implicated in processing of emotions and storing the emotional aspects of memories. Gene activity markers such as c-Fos have been shown to reflect both neuronal activation and neuronal plasticity. Herein, we analyze the expression patterns of gene activity markers in the amygdala in response to either behavioral training or treatment with drugs of abuse and then we confront the results with data on other approaches to internal complexity of the amygdala. c-Fos has been the most often studied in the amygdala, showing specific expression patterns in response to various treatments, most probably reflecting functional specializations among amygdala subdivisions. In the basolateral amygdala, c-Fos expression appears to be consistent with the proposed role of this nucleus in a plasticity of the current stimulus-value associations. Within the medial part of the central amygdala, c-Fos correlates with acquisition of alimentary/gustatory behaviors. On the other hand, in the lateral subdivision of the central amygdala, c-Fos expression relates to attention and vigilance. In the medial amygdala, c-Fos appears to be evoked by emotional novelty of the experimental situation. The data on the other major subdivisions of the amygdala are scarce. In conclusion, the studies on the gene activity markers, confronted with other approaches involving neuroanatomy, physiology, and the lesion method, have revealed novel aspects of the amygdala, especially pointing to functional heterogeneity of this brain region that does not fit very well into contemporarily active debate on serial versus parallel information processing within the amygdala.
Collapse
|
35
|
PARSONS RG, RIEDNER BA, GAFFORD GM, HELMSTETTER FJ. The formation of auditory fear memory requires the synthesis of protein and mRNA in the auditory thalamus. Neuroscience 2006; 141:1163-70. [PMID: 16766126 PMCID: PMC1698266 DOI: 10.1016/j.neuroscience.2006.04.078] [Citation(s) in RCA: 38] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2005] [Revised: 03/17/2006] [Accepted: 04/14/2006] [Indexed: 11/21/2022]
Abstract
The medial geniculate nucleus of the thalamus responds to auditory information and is a critical part of the neural circuitry underlying aversive conditioning with auditory signals for shock. Prior work has shown that lesions of this brain area selectively disrupt conditioning with auditory stimuli and that neurons in the medial geniculate demonstrate plastic changes during fear conditioning. However, recent evidence is less clear as to whether or not this area plays a role in the storage of auditory fear memories. In the current set of experiments rats were given infusions of protein or messenger RNA (mRNA) synthesis inhibitors into the medial geniculate nucleus of the thalamus 30 min prior to auditory fear conditioning. The next day animals were tested to the auditory cue and conditioning context. Results showed that rats infused with either inhibitor demonstrated less freezing to the auditory cue 24 h after training, while freezing to the context was normal. Autoradiography confirmed that the doses used were effective in disrupting synthesis. Taken together with prior work, these data suggest that the formation of fear memory requires the synthesis of new protein and mRNA at multiple brain sites across the neural circuit that supports fear conditioning.
Collapse
Key Words
- pavlovian fear conditioning
- anisomycin
- medial geniculate nucleus
- rat
- distributed plasticity
- consolidation
- acsf, artificial cerebrospinal fluid
- ani, anisomycin
- dmso, dimethyl sulfoxide
- drb, 5,6-dichlorobenzimidazole 1-β-d-ribofuranoside
- erk/mapk, extracellular-signal-related/mitogen-activated protein kinase
- ieg, immediate early gene
- ltp, long-term potentiation
- mgm, medial division of medial geniculate thalamic nucleus
- mrna, messenger rna
- tia, training-induced neuronal activity
Collapse
Affiliation(s)
- R. G. PARSONS
- Department of Psychology, Garland Hall, University of Wisconsin–Milwaukee, P.O. Box 413, Milwaukee, WI 53201, USA
| | | | - G. M. GAFFORD
- Department of Psychology, Garland Hall, University of Wisconsin–Milwaukee, P.O. Box 413, Milwaukee, WI 53201, USA
| | - F. J. HELMSTETTER
- Department of Psychology, Garland Hall, University of Wisconsin–Milwaukee, P.O. Box 413, Milwaukee, WI 53201, USA
| |
Collapse
|
36
|
Rai KS, Murthy KD, Rao MS, Karanth KS. Altered dendritic arborization of amygdala neurons in young adult rats orally intubated with Clitorea ternatea aqueous root extract. Phytother Res 2005; 19:592-8. [PMID: 16161034 DOI: 10.1002/ptr.1657] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Young adult (60 day old) Wistar rats of either sex were orally intubated with 50 mg/kg body weight and 100 mg/kg body weight of aqueous root extract of Clitoria ternatea (CTR) for 30 days, along with age-matched saline controls. These rats were then subjected to passive avoidance tests and the results from these studies showed a significant increase in passive avoidance learning and retention. Subsequent to the passive avoidance tests, these rats were killed by decapitation. The amygdala was processed for Golgi staining and the stained neurons were traced using a camera lucida and analysed. The results showed a significant increase in dendritic intersections, branching points and dendritic processes arising from the soma of amygdaloid neurons in CTR treated rats especially in the 100 mg/kg group of rats, compared with age-matched saline controls. This improved dendritic arborization of amygdaloid neurons correlates with the increased passive avoidance learning and memory in the CTR treated rats as reported earlier. The results suggest that Clitoria ternatea aqueous root extract enhances memory by increasing the functional growth of neurons of the amygdala.
Collapse
Affiliation(s)
- Kiranmai S Rai
- Department of Physiology, K.M.C. Manipal-576104, Karnataka, India.
| | | | | | | |
Collapse
|
37
|
Maren S. Central and basolateral amygdala neurons crash the aversive conditioning party: Theoretical comment on Rorick-Kehn and Steinmetz (2005). Behav Neurosci 2005; 119:1406-10. [PMID: 16300448 DOI: 10.1037/0735-7044.119.5.1406] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Stephen Maren
- Department of Psychology and Neuroscience Program, University of Michigan, 530 Church Street, Ann Arbor, 48109-1043 MI, US.
| |
Collapse
|
38
|
Faure A, Conde F, Cheruel F, el Massioui N. Learning-dependent activation of Fra-1: involvement of ventral hippocampus and SNc/VTA complex in learning and habit formation. Brain Res Bull 2005; 68:233-48. [PMID: 16377429 DOI: 10.1016/j.brainresbull.2005.08.017] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2004] [Revised: 07/20/2005] [Accepted: 08/16/2005] [Indexed: 11/22/2022]
Abstract
Although the effect of overtraining on learning processes in rats has long been studied, only few studies have specifically assessed the differential involvement of brain areas in habit formation. We used the analysis of expression of the immediate early gene Fra-1 as a tool to differentiate the areas involved in training and overtraining. Behavioural experiments showed that instrumental performance (signalled and non-signalled instrumental tasks), but not pavlovian conditioned responses, were no longer under the control of the incentive value of the reward after overtraining. The number of Fra-1 expressing neurons was increased in SNc/VTA and ventral hippocampus after training in all groups independently of behavioural performance. After overtraining, the number of learning-induced Fra-1 immunoreactive neurons remained increased in the SNc/VTA. However, in CA1, it significantly decreased in the signalled instrumental group, whereas it further increased in the pavlovian group, with no modulation in non-signalled instrumental animals. The increase in the number of Fra-1 neurons observed after training in SNc/VTA and ventral hippocampus suggests that a general underlying incentive process regulates Fra-1. Moreover, the sustained increased expression of Fra-1 in the SNc/VTA after instrumental overtraining could reflect a possible role of dopaminergic neurons in habit formation.
Collapse
Affiliation(s)
- Alexis Faure
- Laboratoire de Neurobiologie de l'Apprentissage, de la Mémoire et de la Communication, CNRS UMR 8620, Bat. 446, Université Paris Sud, 91405 Orsay, France.
| | | | | | | |
Collapse
|
39
|
Talk A, Kashef A, Gabriel M. Effects of conditioning during amygdalar inactivation on training-induced neuronal plasticity in the medial geniculate nucleus and cingulate cortex in rabbits (Oryctolagus cuniculus). Behav Neurosci 2005; 118:944-55. [PMID: 15506877 DOI: 10.1037/0735-7044.118.5.944] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
This study addressed the amygdala's role in avoidance conditioning in rabbits (Oryctolagus cuniculus). Intra-amygdalar muscimol infusion before 60 or 120 conditioning trials blocked training-induced neuronal activity (TIA) in the medial geniculate (MG) nucleus. One hundred twenty trials with muscimol blocked TIA permanently, during conditioning with muscimol and then later without muscimol; 60 trials with muscimol blocked TIA only when muscimol was present. Cingulate cortical TIA was blocked only when muscimol was present. Behavioral learning did not occur with muscimol, but later learning was facilitated (i.e., savings occurred) in rabbits initially given muscimol plus training. These results define the time period wherein amygdalar processes initiate TIA in the MG nucleus and suggest that distinct forms of amygdalar processes induce TIA in the MG nucleus and cingulate cortex.
Collapse
Affiliation(s)
- Andrew Talk
- Department of Psychology, Neuroscience Progam and Beckman Institute, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
| | | | | |
Collapse
|
40
|
Featherstone RE, McDonald RJ. Dorsal striatum and stimulus-response learning: lesions of the dorsolateral, but not dorsomedial, striatum impair acquisition of a simple discrimination task. Behav Brain Res 2004; 150:15-23. [PMID: 15033275 DOI: 10.1016/s0166-4328(03)00218-3] [Citation(s) in RCA: 63] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2003] [Revised: 06/10/2003] [Accepted: 06/24/2003] [Indexed: 10/27/2022]
Abstract
In the present experiment, the effects of neurotoxic lesions (quinolinic acid) of the dorsolateral or dorsomedial striatum were investigated on a simple instrumental discrimination task (CS+/CS-). Rats with lesions of the dorsolateral striatum were found to be impaired in the acquisition of this task, as compared to rats with either dorsomedial striatal or sham lesions. Furthermore, dorsolateral striatal lesioned animals had significantly lower levels of responding across the course of discrimination training, as assessed both by overall rate of response during CS+ presentations and number of CS+ trials without a response, despite having shown levels of responding during variable interval training that did not differ from that of sham lesioned animals. In contrast, animals with lesions of the dorsomedial striatum did not show an impairment in acquisition of the present task, but had slightly higher rates of responding during CS- presentations. It is argued that the poor acquisition and low response rates observed in animals with dorsolateral striatal lesions reflect a failure in stimulus-response learning, while the performance of animals with dorsomedial striatal lesions may have been the result of an increase in overall activity rate.
Collapse
Affiliation(s)
- R E Featherstone
- Department of Psychology, University of Toronto, 100 St George Street, Toronto, Canada M5S3G3.
| | | |
Collapse
|
41
|
Holahan MR, White NM. Amygdala inactivation blocks expression of conditioned memory modulation and the promotion of avoidance and freezing. Behav Neurosci 2004; 118:24-35. [PMID: 14979780 DOI: 10.1037/0735-7044.118.1.24] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Rats were exposed to shock-paired cues immediately after training on an appetitive preference task. Elevated levels of freezing in and active avoidance of the shock-paired compartment were observed, and memory for the appetitive task was improved when tested 24 hr later. Intra-amygdala muscimol injected before the posttraining exposure eliminated freezing, avoidance, and memory modulation. The blockade of both freezing and active avoidance, which involve competing behavioral tendencies, makes it unlikely that the amygdala itself generates either behavior. The elimination of conditioned memory modulation suggests that conditioned neurohormonal responses were blocked. These conditioned internal responses may comprise the intervening variable of "conditioned fear" and may promote observable behaviors, the form of which is determined by the environment in which they occur.
Collapse
|
42
|
Botreau F, El Massioui N, Chéruel F, Gisquet-Verrier P. Effects of medial prefrontal cortex and dorsal striatum lesions on retrieval processes in rats. Neuroscience 2004; 129:539-53. [PMID: 15541876 DOI: 10.1016/j.neuroscience.2004.08.032] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/19/2004] [Indexed: 11/16/2022]
Abstract
Exposure to training-related cues is known to reactivate associated memory and improves subsequent retention performance under various circumstances. The present studies investigated the neural basis of retrieval cue effects, by studying in two separate experiments, the involvement of the medial prefrontal cortex and of the dorsal striatum. Rats with lesions to the prelimbic-infralimbic cortex (PL-IL), to the anterior dorsal cingulate (ACd), and to the lateral and medial parts of the dorsal striatum (lDS and mDS) were first trained in a brightness discrimination avoidance task. One day later, rats were tested after being placed in the cueing box with either no training-related cue or with additional exposures to the light discriminative stimulus. None of the lesions affected the acquisition performance. During the retention test, control rats cued with the light in the box exhibited significantly better retention performance than those simply placed in the box, confirming our previous results. While mDS lesions did not modify effects of the retrieval cue, lDS as well as both PL-IL and ACd lesions blocked the facilitative effects of the discriminative stimulus. The present data indicate that ACd, PL-IL and lDS are involved in processes promoted by exposure to training cues, the nature of which are reviewed and discussed. This study in conjunction with previous ones suggests that retrieval cues activate several subcircuits mainly based on an amygdalo-prefrontal-striatum network. Activation of this network results in an improvement of the expression of the associated conditioned response, and may thus be viewed as increasing the efficacy of the retrieval processes.
Collapse
Affiliation(s)
- F Botreau
- Laboratoire de Neurobiologie de l'Apprentissage, de la Mémoire et de la Communication, CNRS UMR 8620, Université Paris Sud, 91405 Orsay Cedex, France
| | | | | | | |
Collapse
|
43
|
Rosenkranz JA, Moore H, Grace AA. The prefrontal cortex regulates lateral amygdala neuronal plasticity and responses to previously conditioned stimuli. J Neurosci 2003; 23:11054-64. [PMID: 14657162 PMCID: PMC6741051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/27/2023] Open
Abstract
The amygdala plays a role in learning and memory processes that involve an emotional component. However, neural structures that regulate these amygdala-dependent processes are unknown. Previous studies indicate that regulation of affect may be imposed by the prefrontal cortex (PFC) and its efferents to the amygdala. The presentation of conditioned affective stimuli enhances activity of neurons in the lateral nucleus of the amygdala (LAT), which is thought to drive conditioned affective responses. Moreover, plasticity of LAT neuronal responses to stimuli during the course of conditioning is believed to underlie affective learning. This study examines the role of the PFC in the regulation of affective behaviors by evaluating how the PFC affects LAT neuronal plasticity and activity that is evoked by previously conditioned stimuli. In vivo intracellular recordings were performed from the LAT of anesthetized rats during pavlovian conditioning and during the presentation of stimuli that were conditioned in the awake rat before recording. Train stimulation of the PFC suppressed LAT neuronal activity that was evoked by both previously conditioned and neutral stimuli. In addition, PFC stimulation blocked LAT neuronal plasticity associated with an affective conditioning procedure. These results indicate that the PFC has the potential to regulate affective processes by inhibition of the LAT. Patients with disruptions of the PFC-LAT interaction often display an inability to regulate affective responses. This may be attributable to the loss of PFC-imposed inhibition of the emotional response to a stimulus but may also include the formation or diminished extinction of inappropriate associations.
Collapse
Affiliation(s)
- J Amiel Rosenkranz
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, Pennsylvania 15260, USA
| | | | | |
Collapse
|
44
|
Lehmann H, Treit D, Parent MB. Spared anterograde memory for shock-probe fear conditioning after inactivation of the amygdala. Learn Mem 2003; 10:261-9. [PMID: 12888544 PMCID: PMC202316 DOI: 10.1101/lm.54103] [Citation(s) in RCA: 19] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Previous studies have shown that amygdala lesions impair avoidance of an electrified probe. This finding has been interpreted as indicating that amygdala lesions reduce fear. It is unclear, however, whether amygdala-lesioned rats learn that the probe is associated with shock. If the lesions prevent the formation of this association, then pretraining reversible inactivation of the amygdala should impair both acquisition and retention performance. To test this hypothesis, the amygdala was inactivated (tetrodotoxin; TTX; 1 ng/side) before a shock-probe acquisition session, and retention was tested 4 d later. The data indicated that, compared with rats infused with vehicle, rats infused with TTX received more shocks during the acquisition session, but more importantly, were not impaired on the retention test. In Experiment 2, we assessed whether the spared memory on the retention test was caused by overtraining during acquisition. We used the same procedure as in Experiment 1, with the exception that the number of shocks the rats received during the acquisition session was limited to four. Again the data indicated that amygdala inactivation did not impair performance on the retention test. These results indicate that amygdala inactivation does not prevent the formation of an association between the shock and the probe and that shock-probe deficits during acquisition likely reflect the amygdala's involvement in other processes.
Collapse
Affiliation(s)
- Hugo Lehmann
- Center for Studies in Behavioral Neurobiology, Concordia University, Montreal, Quebec, Canada H4B 1R6.
| | | | | |
Collapse
|
45
|
Abstract
A converging body of literature over the last 50 years has implicated the amygdala in assigning emotional significance or value to sensory information. In particular, the amygdala has been shown to be an essential component of the circuitry underlying fear-related responses. Disorders in the processing of fear-related information are likely to be the underlying cause of some anxiety disorders in humans such as posttraumatic stress. The amygdaloid complex is a group of more than 10 nuclei that are located in the midtemporal lobe. These nuclei can be distinguished both on cytoarchitectonic and connectional grounds. Anatomical tract tracing studies have shown that these nuclei have extensive intranuclear and internuclear connections. The afferent and efferent connections of the amygdala have also been mapped in detail, showing that the amygdaloid complex has extensive connections with cortical and subcortical regions. Analysis of fear conditioning in rats has suggested that long-term synaptic plasticity of inputs to the amygdala underlies the acquisition and perhaps storage of the fear memory. In agreement with this proposal, synaptic plasticity has been demonstrated at synapses in the amygdala in both in vitro and in vivo studies. In this review, we examine the anatomical and physiological substrates proposed to underlie amygdala function.
Collapse
Affiliation(s)
- P Sah
- School of Biomedical Sciences, The University of Queensland, Brisbane, Queensland 4072, Australia.
| | | | | | | |
Collapse
|
46
|
Kung JC, Su NM, Fan RJ, Chai SC, Shyu BC. Contribution of the anterior cingulate cortex to laser-pain conditioning in rats. Brain Res 2003; 970:58-72. [PMID: 12706248 DOI: 10.1016/s0006-8993(02)04276-2] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
The emotional component of nociception is seldom distinguished from pain behavioral testing. The aim of the present study was to develop a behavioral test that indicates the emotional pain responses using the classical conditioning paradigm. The role of the anterior cingulate cortex (ACC) in the process of this pain conditioning response was also evaluated. In laser-pain conditioning, free moving rats were trained to associate a tone (conditioned stimulus, CS) and short CO(2) laser pulsation (unconditioned stimulus, US). Monotonous tone (800 Hz, 0.6 s) was delivered through a loud-speaker as CS. CO(2) laser pulses (5 W at 50 or 100 ms in duration) applied to the hind paw was adopted as US. The CS-US interval was 0.5 s. Laser-pain conditioning was developed during 40 CS-US pairings. CS and US pairing with 100-ms laser pulse stimuli was more effective in establishing conditioning responses than that of 50-ms stimuli. The conditioning responses remained, tested by presenting CS alone, immediate to and 24 h subsequent to training. The performance of laser-pain conditioning was significantly reduced after bilateral lesioning of the ACC. Similar results were also obtained by bilateral lesions of the amygdala. The conditioning responses were also diminished following morphine treatment. The association between a neutral stimulus and a noxious stimulus could be demonstrated in a Pavlovian conditioning test in free moving rats. Thus, the conditioned response may be employed as a measure of the emotional component of the nociception. It is also suggested that the ACC may play an important role in mediating this conditioning effect.
Collapse
Affiliation(s)
- Jen-Chuang Kung
- Institute of Biomedical Sciences, Academia Sinica, Taipei 115, Taiwan, ROC
| | | | | | | | | |
Collapse
|
47
|
Sewards TV, Sewards MA. The medial pain system: neural representations of the motivational aspect of pain. Brain Res Bull 2002; 59:163-80. [PMID: 12431746 DOI: 10.1016/s0361-9230(02)00864-x] [Citation(s) in RCA: 109] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
In this article, we propose that the pathways mediating the motivational aspect of pain originate in laminae VII and VIII of the spinal cord, and in the deep layers of the spinal trigeminal complex, and projections from these areas reach three central structures where pain motivation is represented, the ventrolateral quadrant of the periaqueductal gray, posterior hypothalamic nucleus, and intralaminar thalamic nuclei. A final representation of the motivational aspect of pain is located within the anterior cingulate cortex, and this representation receives inputs from the intralaminar nuclei. Outputs from these representations reach premotor structures located in the medulla, striatum, and cingulate premotor cortex. We discuss pathways and structures that provide inputs to these representations, including those involved in producing involuntary (innate) and instrumental responses which occur in response to the recognition of stimuli associated with footshock and other nociceptive stimuli.
Collapse
|
48
|
Sanford LD, Parris B, Tang X. GABAergic regulation of the central nucleus of the amygdala: implications for sleep control. Brain Res 2002; 956:276-84. [PMID: 12445696 DOI: 10.1016/s0006-8993(02)03552-7] [Citation(s) in RCA: 48] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
It is becoming established that the amygdala has a strong influence on arousal state, with most evidence indicating a role in the regulation of rapid eye movement sleep (REM). Electrically activating the central nucleus of the amygdala (CNA) can increase subsequent REM and enhance REM-related phenomena. However, drugs that may be inhibitory to CNA have been typically reported to reduce REM. This suggests that enhancing activity in CNA could promote REM, and that inhibiting activity in CNA could suppress REM. We reversibly inactivated CNA using the GABA(A) agonist, muscimol, or blocked GABAergic inhibition with the GABA(A) antagonist, bicuculline, and examined the effects on sleep and wakefulness. Rats (90-day-old male Sprague-Dawley) were implanted with electrodes for recording EEG and EMG. Cannulae were aimed into CNA for microinjecting muscimol (0.001, 0.3 and 1.0 microM/0.2 microl saline) or bicuculline (56 and 333 pM/0.2 microl saline). Each animal received bilateral microinjections of muscimol, bicuculine or saline alone followed by 6-h sleep recordings. Microinjections of low concentrations of muscimol into CNA produced relatively selective decreases in total REM and number of REM episodes that lasted up to 6 h. In contrast, microinjections of bicuculline into CNA produced significant increases in REM. There were no significant reductions in NREM or wakefulness. These findings demonstrate that inactivating CNA can produce a relatively selective suppression of REM. The possible role that spontaneous activity in CNA may play in REM initiation and/or maintenance is discussed.
Collapse
Affiliation(s)
- Larry D Sanford
- Sleep Research Laboratory, Department of Pathology and Anatomy, Eastern Virginia Medical School, PO Box 1980, Norfolk, VA 23501, USA.
| | | | | |
Collapse
|
49
|
Edeline JM, Hars B, Hennevin E, Cotillon N. Muscimol diffusion after intracerebral microinjections: a reevaluation based on electrophysiological and autoradiographic quantifications. Neurobiol Learn Mem 2002; 78:100-24. [PMID: 12071670 DOI: 10.1006/nlme.2001.4035] [Citation(s) in RCA: 127] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
Intracerebral muscimol injection is widely used to inactivate discrete brain structures during behavioral tasks. However, little effort has been made to quantify the extent of muscimol diffusion. The authors report here electrophysiological and autoradiographic results obtained after muscimol injection (1 microg/microl) either into the nucleus basalis magnocellularis (0.1-0.4 microl) or into the thalamic reticular nucleus (RE, 0.05-0.1 microl). In 52 rats, multiunit recordings were collected either in the RE or in the auditory thalamus during the 2 h following muscimol injection. Decreases in neuronal activity were observed up to 3 mm from the injection site; their time of occurrence was a function of the distance between the injection and recording sites. Because these decreases cannot be explained by physiological effects, they likely reflected muscimol diffusion up to the recording sites. Autoradiographic studies involved 25 rats and different experimental conditions. Optical density (OD) measures indicated that after a survival time of 15 min, a 0.05 microl injection produced a labeled area of 5.25 mm(2) at the injection site and a rostrocaudal labeling of 1.7 mm. Increasing the survival time to 60 min, or increasing the injected volume to 0.1 microl, systematically led to a larger labeled area at the injection site (8-12 mm(2)) and to a larger rostrocaudal diffusion (2.0-2.5 mm). Direct quantifications of radioactivity by a high-resolution radioimager validated the OD measures and even indicated a larger muscimol diffusion (up to 3.25 mm). Thus, these data point out that muscimol diffusion after intracerebral microinjection is larger than usually supposed. The relationships between these results and those obtained in behavioral studies are discussed.
Collapse
Affiliation(s)
- Jean-Marc Edeline
- Laboratoire de Neurobiologie de l'Apprentissage, de la Mémoire et de la Communication, UMR CNRS 8620, Université Paris-Sud, 91405 Orsay, France.
| | | | | | | |
Collapse
|
50
|
Smith DM, Monteverde J, Schwartz E, Freeman JH, Gabriel M. Lesions in the central nucleus of the amygdala: discriminative avoidance learning, discriminative approach learning, and cingulothalamic training-induced neuronal activity. Neurobiol Learn Mem 2001; 76:403-25. [PMID: 11726245 DOI: 10.1006/nlme.2001.4019] [Citation(s) in RCA: 16] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
The amygdala is critically involved in discriminative avoidance learning. Large lesions of the amygdala block discriminative avoidance learning and abolish cingulothalamic training-induced neuronal activity. These results indicated that amygdalar processing is critical for cingulothalamic plasticity. The larger lesions did not allow differentiation of the specific functioning of various amygdalar nuclei. Anatomical analysis showed that damage in the central (CE) nucleus of the amygdala was correlated with the severity of the behavioral deficit. The present study was carried out to determine whether smaller lesions, centered in the CE nucleus, would impair discriminative avoidance learning and block cingulothalamic plasticity. In addition, the possible role of the CE nucleus in appetitively motivated discriminative approach learning was examined for the first time. New Zealand White rabbits with CE nuclear lesions were first trained in the discriminative approach task. After attaining asymptotic performance, discriminative avoidance training sessions were alternated with continuing approach training sessions, one session each day. The rabbits with lesions were severely impaired in avoidance learning but showed no impairment of approach learning. Surprisingly, the attenuating effects of the lesions on cingulothalamic training-induced neuronal activity were more prevalent during approach learning than during avoidance learning. These results indicated that avoidance learning can be impaired by lesions centered in the CE nucleus that leave cingulothalamic plasticity largely intact and that the CE nucleus is involved in extra-cingulothalamic learning processes.
Collapse
Affiliation(s)
- D M Smith
- Neuroscience Program, Beckman Institute, Urbana, Illinois 61801, USA
| | | | | | | | | |
Collapse
|