1
|
Leeuwis M, Asar Y, White JJ, Rasman BG, Forbes PA. Different mechanisms of contextual inference govern associatively learned and sensory-evoked postural responses. Proc Natl Acad Sci U S A 2024; 121:e2404909121. [PMID: 39093946 PMCID: PMC11317596 DOI: 10.1073/pnas.2404909121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2024] [Accepted: 06/30/2024] [Indexed: 08/04/2024] Open
Abstract
Human standing balance relies on the continuous monitoring and integration of sensory signals to infer our body's motion and orientation within the environment. However, when sensory information is no longer contextually relevant to balancing the body (e.g., when sensory and motor signals are incongruent), sensory-evoked balance responses are rapidly suppressed, much earlier than any conscious perception of changes in balance control. Here, we used a robotic balance simulator to assess whether associatively learned postural responses are similarly modulated by sensorimotor incongruence and contextual relevance to postural control. Twenty-nine participants in three groups were classically conditioned to generate postural responses to whole-body perturbations when presented with an initially neutral sound cue. During catch and extinction trials, participants received only the auditory stimulus but in different sensorimotor states corresponding to their group: 1) during normal active balance, 2) while immobilized, and 3) throughout periods where the computer subtly removed active control over balance. In the balancing and immobilized states, conditioned responses were either evoked or suppressed, respectively, according to the (in)ability to control movement. Following the immobilized state, conditioned responses were renewed when balance was restored, indicating that conditioning was retained but only expressed when contextually relevant. In contrast, conditioned responses persisted in the computer-controlled state even though there was no causal relationship between motor and sensory signals. These findings suggest that mechanisms responsible for sensory-evoked and conditioned postural responses do not share a single, central contextual inference and assessment of their relevance to postural control, and may instead operate in parallel.
Collapse
Affiliation(s)
- Matto Leeuwis
- Department of Neuroscience, Erasmus MC, University Medical Center Rotterdam, Rotterdam3015 GD, The Netherlands
| | - Yomna Asar
- Department of Neuroscience, Erasmus MC, University Medical Center Rotterdam, Rotterdam3015 GD, The Netherlands
| | - Joshua J. White
- Department of Neuroscience, Erasmus MC, University Medical Center Rotterdam, Rotterdam3015 GD, The Netherlands
| | - Brandon G. Rasman
- Department of Neuroscience, Erasmus MC, University Medical Center Rotterdam, Rotterdam3015 GD, The Netherlands
- Department of Sensorimotor Neuroscience, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen6525 GD, The Netherlands
| | - Patrick A. Forbes
- Department of Neuroscience, Erasmus MC, University Medical Center Rotterdam, Rotterdam3015 GD, The Netherlands
| |
Collapse
|
2
|
Oleksiak CR, Plas SL, Carriaga D, Vasudevan K, Maren S, Moscarello JM. Ventral hippocampus mediates inter-trial responding in signaled active avoidance. Behav Brain Res 2024; 470:115071. [PMID: 38806099 DOI: 10.1016/j.bbr.2024.115071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2024] [Revised: 05/07/2024] [Accepted: 05/24/2024] [Indexed: 05/30/2024]
Abstract
The hippocampus has a central role in regulating contextual processes in memory. We have shown that pharmacological inactivation of ventral hippocampus (VH) attenuates the context-dependence of signaled active avoidance (SAA) in rats. Here, we explore whether the VH mediates intertrial responses (ITRs), which are putative unreinforced avoidance responses that occur between trials. First, we examined whether VH inactivation would affect ITRs. Male rats underwent SAA training and subsequently received intra-VH infusions of saline or muscimol before retrieval tests in the training context. Rats that received muscimol performed significantly fewer ITRs, but equivalent avoidance responses, compared to controls. Next, we asked whether chemogenetic VH activation would increase ITR vigor. In male and female rats expressing excitatory (hM3Dq) DREADDs, systemic CNO administration produced a robust ITR increase that was not due to nonspecific locomotor effects. Then, we examined whether chemogenetic VH activation potentiated ITRs in an alternate (non-training) test context and found it did. Finally, to determine if context-US associations mediate ITRs, we exposed rats to the training context for three days after SAA training to extinguish the context. Rats submitted to context extinction did not show a reliable decrease in ITRs during a retrieval test, suggesting that context-US associations are not responsible for ITRs. Collectively, these results reveal an important role for the VH in context-dependent ITRs during SAA. Further work is required to explore the neural circuits and associative basis for these responses, which may be underlie pathological avoidance that occurs in humans after threat has passed.
Collapse
Affiliation(s)
- Cecily R Oleksiak
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX 77845, USA; Texas A&M Institute for Neuroscience, Texas A&M University, College Station, TX 77845, USA
| | - Samantha L Plas
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX 77845, USA; Texas A&M Institute for Neuroscience, Texas A&M University, College Station, TX 77845, USA
| | - Denise Carriaga
- Department of Psychological Science, University of Texas Rio Grande Valley, TX 78539
| | - Krithika Vasudevan
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX 77845, USA; Texas A&M Institute for Neuroscience, Texas A&M University, College Station, TX 77845, USA
| | - Stephen Maren
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX 77845, USA; Texas A&M Institute for Neuroscience, Texas A&M University, College Station, TX 77845, USA
| | - Justin M Moscarello
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX 77845, USA; Texas A&M Institute for Neuroscience, Texas A&M University, College Station, TX 77845, USA.
| |
Collapse
|
3
|
Robinson PK, Met Hoxha E, Williams D, Kinzig KP, Trask S. Fear extinction is impaired in aged rats. GeroScience 2024; 46:2815-2825. [PMID: 38349449 PMCID: PMC11009175 DOI: 10.1007/s11357-024-01084-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 01/17/2024] [Indexed: 04/13/2024] Open
Abstract
Normal aging is accompanied by broad loss of cognitive function in humans and rodents, including declines in cognitive flexibility. In extinction, a conditional stimulus (CS) that was previously paired with a footshock is presented alone. This procedure reliably reduces conditional freezing behavior in young adult rats. Here, we aimed to investigate how normal aging affects extinction learning. Using young (3 months) and aged (20 months) male and female Long Evans rats, we compared extinction (using 20 CS-alone presentations) to a no extinction control (equal exposure to the conditioning chamber without CS presentations) following delay fear conditioning. We found that young animals in the extinction group showed a decrease in freezing following extinction; aged animals did not. We next examined changes in neural activity using expression of the immediate early gene zif268. In young animals, extinction corresponded with decreased expression of zif268 in the basolateral amygdala and anterior retrosplenial cortex; this was not observed in aged animals. Further, aged animals showed increased zif268 expression in each region examined, suggesting that dysfunction in neural activity precedes cognitive deficits. These results demonstrate that aging impacts both extinction learning and neural activity.
Collapse
Affiliation(s)
- Payton K Robinson
- Department of Psychological Sciences, Purdue University, West Lafayette, IN, 47907, USA
| | - Erisa Met Hoxha
- Department of Psychological Sciences, Purdue University, West Lafayette, IN, 47907, USA
| | - Destine Williams
- Department of Psychological Sciences, Purdue University, West Lafayette, IN, 47907, USA
| | - Kimberly P Kinzig
- Department of Psychological Sciences, Purdue University, West Lafayette, IN, 47907, USA
- Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN, 47907, USA
| | - Sydney Trask
- Department of Psychological Sciences, Purdue University, West Lafayette, IN, 47907, USA.
- Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN, 47907, USA.
- Center On Aging and the Life Course, Purdue University, West Lafayette, IN, 47907, USA.
| |
Collapse
|
4
|
Nevado B, Nelson JB. Perceived stress and renewal: The effects of long-term stress on the renewal effect. Neurobiol Learn Mem 2024; 211:107927. [PMID: 38582295 DOI: 10.1016/j.nlm.2024.107927] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Revised: 03/19/2024] [Accepted: 04/03/2024] [Indexed: 04/08/2024]
Abstract
Two online experiments evaluated the relationship between long-term stress, as measured with the Perceived Stress Scale-10, and the Renewal Effect. In the first experiment renewal was assessed with a behavioral suppression task in a science-fiction based video game. Participants learned to suppress mouse clicking during a signal for an upcoming attack to avoid losing points. The signal was first paired with an attack in Context A and extinguished in Context B and tested back in Context A. The contexts were different space galaxies where the gameplay took place. Experiment 2 used a food/illness predictive-learning paradigm. Two food items were paired with stomachache in one restaurant (A) and extinguished in Context B prior to testing in both contexts without feedback. Positive correlations were obtained between renewal and stress in each experiment. Unlike acute stress (Drexler et al., 2017), long term stress was associated with greater renewal. The effects of stress, both chronic and punctual, on renewal are discussed.
Collapse
Affiliation(s)
- Borja Nevado
- University of the Basque Country (UPV/EHU), Spain.
| | | |
Collapse
|
5
|
Knox D, Parikh V. Basal forebrain cholinergic systems as circuits through which traumatic stress disrupts emotional memory regulation. Neurosci Biobehav Rev 2024; 159:105569. [PMID: 38309497 PMCID: PMC10948307 DOI: 10.1016/j.neubiorev.2024.105569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 01/25/2024] [Accepted: 01/29/2024] [Indexed: 02/05/2024]
Abstract
Contextual and spatial systems facilitate changes in emotional memory regulation brought on by traumatic stress. Cholinergic basal forebrain (chBF) neurons provide input to contextual/spatial systems and although chBF neurons are important for emotional memory, it is unknown how they contribute to the traumatic stress effects on emotional memory. Clusters of chBF neurons that project to the prefrontal cortex (PFC) modulate fear conditioned suppression and passive avoidance, while clusters of chBF neurons that project to the hippocampus (Hipp) and PFC (i.e. cholinergic medial septum and diagonal bands of Broca (chMS/DBB neurons) are critical for fear extinction. Interestingly, neither Hipp nor PFC projecting chMS/DBB neurons are critical for fear extinction. The retrosplenial cortex (RSC) is a contextual/spatial memory system that receives input from chMS/DBB neurons, but whether this chMS/DBB-RSC circuit facilitates traumatic stress effects on emotional memory remain unexplored. Traumatic stress leads to neuroinflammation and the buildup of reactive oxygen species. These two molecular processes may converge to disrupt chBF circuits enhancing the impact of traumatic stress on emotional memory.
Collapse
Affiliation(s)
- Dayan Knox
- Department of Psychological and Brain Sciences, Behavioral Neuroscience Program, University of Delaware, Newark, DE, USA.
| | - Vinay Parikh
- Department of Psychology, Neuroscience Program, Temple University, Philadelphia, PA, USA
| |
Collapse
|
6
|
Oleksiak CR, Plas SL, Carriaga D, Vasudevan K, Maren S, Moscarello JM. Ventral hippocampus mediates inter-trial responding in signaled active avoidance. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.18.585627. [PMID: 38562746 PMCID: PMC10983994 DOI: 10.1101/2024.03.18.585627] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
The hippocampus has a central role in regulating contextual processes in memory. We have shown that pharmacological inactivation of ventral hippocampus (VH) attenuates the context-dependence of signaled active avoidance (SAA) in rats. Here, we explore whether the VH mediates intertrial responses (ITRs), which are putative unreinforced avoidance responses that occur between trials. First, we examined whether VH inactivation would affect ITRs. Male rats underwent SAA training and subsequently received intra-VH infusions of saline or muscimol before retrieval tests in the training context. Rats that received muscimol performed significantly fewer ITRs, but equivalent avoidance responses, compared to controls. Next, we asked whether chemogenetic VH activation would increase ITR vigor. In male and female rats expressing excitatory (hM3Dq) DREADDs, systemic CNO administration produced a robust ITR increase that was not due to nonspecific locomotor effects. Then, we examined whether chemogenetic VH activation potentiated ITRs in an alternate (non-training) test context and found it did. Finally, to determine if context-US associations mediate ITRs, we exposed rats to the training context for three days after SAA training to extinguish the context. Rats submitted to context extinction did not show a reliable decrease in ITRs during a retrieval test, suggesting that context-US associations are not responsible for ITRs. Collectively, these results reveal an important role for the VH in context-dependent ITRs during SAA. Further work is required to explore the neural circuits and associative basis for these responses, which may be underlie pathological avoidance that occurs in humans after threat has passed.
Collapse
Affiliation(s)
- Cecily R. Oleksiak
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX 77845
- Texas A&M Institute for Neuroscience, Texas A&M University, College Station, TX 77845
| | - Samantha L. Plas
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX 77845
- Texas A&M Institute for Neuroscience, Texas A&M University, College Station, TX 77845
| | - Denise Carriaga
- Department of Psychological Science, University of Texas Rio Grande Valley, TX 78539
| | - Krithika Vasudevan
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX 77845
- Texas A&M Institute for Neuroscience, Texas A&M University, College Station, TX 77845
| | - Stephen Maren
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX 77845
- Texas A&M Institute for Neuroscience, Texas A&M University, College Station, TX 77845
| | - Justin M. Moscarello
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX 77845
- Texas A&M Institute for Neuroscience, Texas A&M University, College Station, TX 77845
| |
Collapse
|
7
|
van Veen SC, Zbozinek TD, van Dis EAM, Engelhard IM, Craske MG. Positive mood induction does not reduce return of fear: A virtual reality exposure study for public speaking anxiety. Behav Res Ther 2024; 174:104490. [PMID: 38354451 DOI: 10.1016/j.brat.2024.104490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Revised: 01/26/2024] [Accepted: 01/30/2024] [Indexed: 02/16/2024]
Abstract
Previous laboratory work has shown that induction of positive mood prior to fear extinction decreases the negative valence of the conditional stimulus (CS) and reduces reinstatement of fear. Before translating these insights to clinical practice, it is important to test this strategy in anxious individuals. Students with a high fear of public speaking (N = 62) were randomized to either a positive mood induction, a negative mood induction, or no induction control group. All participants performed two weekly sessions of virtual reality exposure and a 1-week follow-up test including a spontaneous recovery test and reinstatement test after a social rejection (unconditional stimulus). We used self-reported fear measures and skin conductance responses. We expected that the positive group, compared to the other groups, would evaluate the CS (i.e., speaking in front of an audience) as less negative following exposure and would show less spontaneous recovery and reinstatement of fear following a social rejection. Although mood was successfully manipulated, there were no group differences in CS valence following exposure. In all conditions, VR exposure successfully reduced public speaking fear, and these effects were stable at follow-up. In contrast with expectations, the positive group showed more spontaneous recovery of CS negative valence than the negative group. To conclude, we found no evidence that positive mood induction prior to exposure optimizes exposure effects for anxious individuals.
Collapse
Affiliation(s)
| | - Tomislav D Zbozinek
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, United States
| | - Eva A M van Dis
- Department of Clinical Psychology, Utrecht University, the Netherlands
| | - Iris M Engelhard
- Department of Clinical Psychology, Utrecht University, the Netherlands.
| | - Michelle G Craske
- Department of Psychology, University of California, Los Angeles, CA, United States
| |
Collapse
|
8
|
Crombie KM, Azar A, Botsford C, Heilicher M, Jaeb M, Gruichich TS, Schomaker CM, Williams R, Stowe ZN, Dunsmoor JE, Cisler JM. Decoding context memories for threat in large-scale neural networks. Cereb Cortex 2024; 34:bhae018. [PMID: 38300181 PMCID: PMC10839849 DOI: 10.1093/cercor/bhae018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Revised: 01/08/2024] [Accepted: 01/10/2024] [Indexed: 02/02/2024] Open
Abstract
Humans are often tasked with determining the degree to which a given situation poses threat. Salient cues present during prior events help bring online memories for context, which plays an informative role in this process. However, it is relatively unknown whether and how individuals use features of the environment to retrieve context memories for threat, enabling accurate inferences about the current level of danger/threat (i.e. retrieve appropriate memory) when there is a degree of ambiguity surrounding the present context. We leveraged computational neuroscience approaches (i.e. independent component analysis and multivariate pattern analyses) to decode large-scale neural network activity patterns engaged during learning and inferring threat context during a novel functional magnetic resonance imaging task. Here, we report that individuals accurately infer threat contexts under ambiguous conditions through neural reinstatement of large-scale network activity patterns (specifically striatum, salience, and frontoparietal networks) that track the signal value of environmental cues, which, in turn, allows reinstatement of a mental representation, primarily within a ventral visual network, of the previously learned threat context. These results provide novel insight into distinct, but overlapping, neural mechanisms by which individuals may utilize prior learning to effectively make decisions about ambiguous threat-related contexts as they navigate the environment.
Collapse
Affiliation(s)
- Kevin M Crombie
- Department of Psychiatry and Behavioral Sciences, The University of Texas at Austin, 1601 Trinity Street, Building B, Austin, TX 78712, United States
- Department of Kinesiology, The University of Alabama, 620 Judy Bonner Drive, Box 870312, Tuscaloosa, AL 35487, United States
| | - Ameera Azar
- Department of Psychiatry and Behavioral Sciences, The University of Texas at Austin, 1601 Trinity Street, Building B, Austin, TX 78712, United States
| | - Chloe Botsford
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Mickela Heilicher
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Michael Jaeb
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Tijana Sagorac Gruichich
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Chloe M Schomaker
- Department of Psychiatry and Behavioral Sciences, The University of Texas at Austin, 1601 Trinity Street, Building B, Austin, TX 78712, United States
| | - Rachel Williams
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Zachary N Stowe
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Joseph E Dunsmoor
- Department of Psychiatry and Behavioral Sciences, The University of Texas at Austin, 1601 Trinity Street, Building B, Austin, TX 78712, United States
- Institute for Neuroscience, The University of Texas at Austin, Austin, TX 78712, United States
- Department of Neuroscience, The University of Texas at Austin, 1 University Station, Stop C7000, Austin, TX 78712, United States
| | - Josh M Cisler
- Department of Psychiatry and Behavioral Sciences, The University of Texas at Austin, 1601 Trinity Street, Building B, Austin, TX 78712, United States
- Institute for Early Life Adversity Research, The University of Texas at Austin Dell Medical School, 1601 Trinity Street, Building B, Austin, TX 78712, United States
| |
Collapse
|
9
|
Bonanno GR, Met Hoxha E, Robinson PK, Ferrara NC, Trask S. Fear Reduced Through Unconditional Stimulus Deflation Is Behaviorally Distinct From Extinction and Differentially Engages the Amygdala. BIOLOGICAL PSYCHIATRY GLOBAL OPEN SCIENCE 2023; 3:756-765. [PMID: 37881558 PMCID: PMC10593882 DOI: 10.1016/j.bpsgos.2023.01.001] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 12/19/2022] [Accepted: 01/06/2023] [Indexed: 01/14/2023] Open
Abstract
Background Context fear memory can be reliably reduced by subsequent pairings of that context with a weaker shock. This procedure shares similarities with extinction learning: both involve extended time in the conditioning chamber following training and reduce context-elicited fear. Unlike extinction, this weak-shock exposure has been hypothesized to engage reconsolidation-like processes that weaken the original memory. Methods We directly compared the weak-shock procedure with extinction using male and female Long Evans rats. Results Both repeated weak-shock exposure and extinction resulted in decreased context freezing relative to animals that received context fear conditioning but no subsequent context exposure. Conditioning with the weak shock was not enough to form a persistent context-shock association on its own, suggesting that the weak-shock procedure does not create a new memory. Weak-shock exposure in a new context can still reduce freezing elicited by the training context, suggesting that it reduces responding through a different process than extinction, which does not transcend context. Finally, reduced fear behavior produced through both extinction and weak-shock exposure was mirrored by reduced zif268 expression in the basolateral amygdala. However, only the weak-shock procedure resulted in changes in lysine-48 polyubiquitin tagging in the synapse of the basolateral amygdala, suggesting that this procedure produced long-lasting changes in synaptic function within the basolateral amygdala. Conclusions These results suggest that the weak-shock procedure does not rely on the creation of a new inhibitory memory, as in extinction, and instead may alter the original representation of the shock to reduce fear responding.
Collapse
Affiliation(s)
| | - Erisa Met Hoxha
- Purdue University Department of Psychological Sciences, West Lafayette, Indiana
| | - Payton K. Robinson
- Purdue University Department of Psychological Sciences, West Lafayette, Indiana
| | - Nicole C. Ferrara
- Purdue University Department of Psychological Sciences, West Lafayette, Indiana
- Rosalind Franklin University of Medicine and Science Discipline of Physiology and Biophysics, North Chicago, Illinois
- Center for Neurobiology of Stress Resilience and Psychiatric Disorders, North Chicago, Illinois
| | - Sydney Trask
- Purdue University Department of Psychological Sciences, West Lafayette, Indiana
- Purdue Institute for Integrative Neuroscience, West Lafayette, Indiana
| |
Collapse
|
10
|
Piquet R, Faugère A, Parkes SL. Contribution of dorsal versus ventral hippocampus to the hierarchical modulation of goal-directed actions in rats. Eur J Neurosci 2023; 58:3737-3750. [PMID: 37697949 DOI: 10.1111/ejn.16143] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 08/21/2023] [Accepted: 08/28/2023] [Indexed: 09/13/2023]
Abstract
Adaptive behaviour often necessitates that animals learn about events in a manner that is specific to a particular context or environment. These hierarchical organisations allow the animal to decide which action is the most appropriate when faced with ambiguous or conflicting possibilities. This study examined the role of hippocampus in enabling animals to use the context to guide action selection. We used a hierarchical instrumental outcome devaluation task in which male rats learn that the context provides information about the unique action-outcome relations that are in effect. We first confirmed that rats encode and use hierarchical context-(action-outcome) relations. We then show that chemogenetic inhibition of ventral hippocampus impairs both the encoding and retrieval of these associations, while inhibition of dorsal hippocampus impairs only the retrieval. Importantly, neither dorsal nor ventral hippocampus was required for goal-directed behaviour per se as these impairments only emerged when rats were forced to use the context to identify the current action-outcome relationships. These findings are discussed with respect to the role of the hippocampus and its broader circuitry in the contextual modulation of goal-directed behaviour and the importance of hierarchical associations in flexible behaviour.
Collapse
Affiliation(s)
- Robin Piquet
- University of Bordeaux, CNRS, INCIA, UMR 5287, Bordeaux, France
| | | | - Shauna L Parkes
- University of Bordeaux, CNRS, INCIA, UMR 5287, Bordeaux, France
| |
Collapse
|
11
|
Broomer MC, Bouton ME. A comparison of renewal, spontaneous recovery, and reacquisition after punishment and extinction. Learn Behav 2023; 51:262-273. [PMID: 36344750 PMCID: PMC10204583 DOI: 10.3758/s13420-022-00552-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/24/2022] [Indexed: 11/09/2022]
Abstract
Punishment and extinction are both effective methods of reducing instrumental responding and may involve similar learning mechanisms. To characterize the similarities and differences between them, we examined three well-established recovery or "relapse" effects -renewal, spontaneous recovery, and reacquisition - following either punishment or extinction of an instrumental response. In Experiment 1a, both punished and extinguished responses renewed to similar degrees following a context change at test (ABA renewal). In Experiment 1b, responding spontaneously recovered to similar degrees following punishment or extinction. In Experiment 2, responding was rapidly reacquired when the response was reinforced again following extinction but not following punishment, as predicted by the idea that the reinforcer delivered in reacquisition is part of the context of punishment, but not extinction. The results collectively suggest that both punishment and extinction produce similar context-dependent retroactive interference effects. More broadly, they also suggest that punished and extinguished responses may be equally likely to return following a change of context despite the intuition that punishment might provide a more extreme and effective means of suppressing behavior. To our knowledge, this is the first direct behavioral comparison of response recovery after punishment and extinction within individual experiments.
Collapse
Affiliation(s)
- Matthew C Broomer
- Department of Psychological Science, University of Vermont, Burlington, VT, 05405-0134, USA
| | - Mark E Bouton
- Department of Psychological Science, University of Vermont, Burlington, VT, 05405-0134, USA.
| |
Collapse
|
12
|
Nguyen R, Koukoutselos K, Forro T, Ciocchi S. Fear extinction relies on ventral hippocampal safety codes shaped by the amygdala. SCIENCE ADVANCES 2023; 9:eadg4881. [PMID: 37256958 PMCID: PMC10413664 DOI: 10.1126/sciadv.adg4881] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Accepted: 04/25/2023] [Indexed: 06/02/2023]
Abstract
Extinction memory retrieval is influenced by spatial contextual information that determines responding to conditioned stimuli (CS). However, it is poorly understood whether contextual representations are imbued with emotional values to support memory selection. Here, we performed activity-dependent engram tagging and in vivo single-unit electrophysiological recordings from the ventral hippocampus (vH) while optogenetically manipulating basolateral amygdala (BLA) inputs during the formation of cued fear extinction memory. During fear extinction when CS acquire safety properties, we found that CS-related activity in the vH reactivated during sleep consolidation and was strengthened upon memory retrieval. Moreover, fear extinction memory was facilitated when the extinction context exhibited precise coding of its affective zones. Last, these activity patterns along with the retrieval of the fear extinction memory were dependent on glutamatergic transmission from the BLA during extinction learning. Thus, fear extinction memory relies on the formation of contextual and stimulus safety representations in the vH instructed by the BLA.
Collapse
Affiliation(s)
| | | | - Thomas Forro
- Laboratory of Systems Neuroscience, Department of Physiology, University of Bern, Bern, Switzerland
| | | |
Collapse
|
13
|
Melles H, Duijvis S, Jansen A. Inhibitory Learning during Exposure Treatment in Anorexia Nervosa: A Practical Guide. Behav Sci (Basel) 2023; 13:bs13050370. [PMID: 37232607 DOI: 10.3390/bs13050370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Revised: 04/21/2023] [Accepted: 04/27/2023] [Indexed: 05/27/2023] Open
Abstract
Exposure therapy is known to be an effective intervention in the treatment of anxiety-related disorders. In eating disorders, such as anorexia nervosa, anxiety and avoidance are identified as maintenance factors. Therefore, they may constitute an important treatment target, suitable for the use of exposure therapy. Remarkably, exposure techniques to target fears and avoidance behaviors are not commonly used in the treatment of anorexia nervosa. We present a practical guide for the implementation of exposure therapy in the treatment of anorexia nervosa. We outline how exposure therapy is supposed to work according to the inhibitory learning model and how the exposure intervention can be designed for individuals with anorexia nervosa. Practical examples are provided through the case presentation of a patient with anorexia nervosa who completed 31 exposure sessions that focused on her fears of food, eating, weight, weight gain, their feared social consequences and the associated safety behaviors.
Collapse
Affiliation(s)
- Hanna Melles
- Department of Clinical Psychological Science, Faculty of Psychology and Neuroscience, Maastricht University, P.O. Box 616, 6200 MD Maastricht, The Netherlands
| | - Stefanie Duijvis
- Department of Clinical Psychological Science, Faculty of Psychology and Neuroscience, Maastricht University, P.O. Box 616, 6200 MD Maastricht, The Netherlands
| | - Anita Jansen
- Department of Clinical Psychological Science, Faculty of Psychology and Neuroscience, Maastricht University, P.O. Box 616, 6200 MD Maastricht, The Netherlands
| |
Collapse
|
14
|
Ferrara NC, Kwapis JL, Trask S. Memory retrieval, reconsolidation, and extinction: Exploring the boundary conditions of post-conditioning cue exposure. Front Synaptic Neurosci 2023; 15:1146665. [PMID: 36937567 PMCID: PMC10017482 DOI: 10.3389/fnsyn.2023.1146665] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 02/17/2023] [Indexed: 03/06/2023] Open
Abstract
Following fear conditioning, behavior can be reduced by giving many CS-alone presentations in a process known as extinction or by presenting a few CS-alone presentations and interfering with subsequent memory reconsolidation. While the two share procedural similarities, both the behavioral outcomes and the neurobiological underpinnings are distinct. Here we review the neural and behavioral mechanisms that produce these separate behavioral reductions, as well as some factors that determine whether or not a retrieval-dependent reconsolidation process or an extinction process will be in effect.
Collapse
Affiliation(s)
- Nicole C. Ferrara
- Discipline of Physiology and Biophysics, Rosalind Franklin University, North Chicago, IL, United States
- Center for Neurobiology of Stress Resilience and Psychiatric Disorders, Rosalind Franklin University, North Chicago, IL, United States
| | - Janine L. Kwapis
- Department of Biology, The Pennsylvania State University, University Park, PA, United States
| | - Sydney Trask
- Department of Psychological Sciences, Purdue University, West Lafayette, IN, United States
- Purdue Institute for Integrative Neuroscience, West Lafayette, IN, United States
| |
Collapse
|
15
|
Valyear MD, LeCocq MR, Brown A, Villaruel FR, Segal D, Chaudhri N. Learning processes in relapse to alcohol use: lessons from animal models. Psychopharmacology (Berl) 2023; 240:393-416. [PMID: 36264342 DOI: 10.1007/s00213-022-06254-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Accepted: 10/02/2022] [Indexed: 11/29/2022]
Abstract
RATIONALE Alcohol use is reliably preceded by discrete and contextual stimuli which, through diverse learning processes, acquire the capacity to promote alcohol use and relapse to alcohol use. OBJECTIVE We review contemporary extinction, renewal, reinstatement, occasion setting, and sex differences research within a conditioning framework of relapse to alcohol use to inform the development of behavioural and pharmacological therapies. KEY FINDINGS Diverse learning processes and corresponding neurobiological substrates contribute to relapse to alcohol use. Results from animal models indicate that cortical, thalamic, accumbal, hypothalamic, mesolimbic, glutamatergic, opioidergic, and dopaminergic circuitries contribute to alcohol relapse through separable learning processes. Behavioural therapies could be improved by increasing the endurance and generalizability of extinction learning and should incorporate whether discrete cues and contexts influence behaviour through direct excitatory conditioning or occasion setting mechanisms. The types of learning processes that most effectively influence responding for alcohol differ in female and male rats. CONCLUSION Sophisticated conditioning experiments suggest that diverse learning processes are mediated by distinct neural circuits and contribute to relapse to alcohol use. These experiments also suggest that gender-specific behavioural and pharmacological interventions are a way towards efficacious therapies to prevent relapse to alcohol use.
Collapse
Affiliation(s)
- Milan D Valyear
- Center for Studies in Behavioral Neurobiology, Department of Psychology, Concordia University, Montréal, QC, Canada. .,Department of Psychology, McGill University, 1205 Ave. Dr. Penfield, Room N8/5, Montréal, QC, H3A 1B1, Canada.
| | - Mandy R LeCocq
- Center for Studies in Behavioral Neurobiology, Department of Psychology, Concordia University, Montréal, QC, Canada
| | - Alexa Brown
- Center for Studies in Behavioral Neurobiology, Department of Psychology, Concordia University, Montréal, QC, Canada
| | - Franz R Villaruel
- Center for Studies in Behavioral Neurobiology, Department of Psychology, Concordia University, Montréal, QC, Canada
| | - Diana Segal
- Center for Studies in Behavioral Neurobiology, Department of Psychology, Concordia University, Montréal, QC, Canada
| | - Nadia Chaudhri
- Center for Studies in Behavioral Neurobiology, Department of Psychology, Concordia University, Montréal, QC, Canada
| |
Collapse
|
16
|
Fraser KM, Janak PH. Basolateral amygdala and orbitofrontal cortex, but not dorsal hippocampus, are necessary for the control of reward-seeking by occasion setters. Psychopharmacology (Berl) 2023; 240:623-635. [PMID: 36056949 PMCID: PMC9931670 DOI: 10.1007/s00213-022-06227-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Accepted: 08/27/2022] [Indexed: 10/14/2022]
Abstract
Reward-seeking in the world is driven by cues that can have ambiguous predictive and motivational value. To produce adaptive, flexible reward-seeking, it is necessary to exploit occasion setters, other distinct features in the environment, to resolve the ambiguity of Pavlovian reward-paired cues. Despite this, very little research has investigated the neurobiological underpinnings of occasion setting, and as a result little is known about which brain regions are critical for occasion setting. To address this, we exploited a recently developed task that was amenable to neurobiological inquiry where a conditioned stimulus is only predictive of reward delivery if preceded in time by the non-overlapping presentation of a separate cue-an occasion setter. This task required male rats to maintain and link cue-triggered expectations across time to produce adaptive reward-seeking. We interrogated the contributions of the basolateral amygdala and orbitofrontal cortex to occasion setting as these regions are thought to be critical for the computation and exploitation of state value, respectively. Reversible inactivation of either structure prior to the occasion-setting task resulted in a profound inability of rats to use the occasion setter to guide reward-seeking. In contrast, inactivation of the dorsal hippocampus, a region fundamental for context-specific responding was without effect nor did inactivation of the basolateral amygdala or orbitofrontal cortex in a standard Pavlovian conditioning preparation affect conditioned responding. We conclude that neural activity within the orbitofrontal cortex and basolateral amygdala circuit is necessary to update and resolve ambiguity in the environment to promote cue-driven reward-seeking.
Collapse
Affiliation(s)
- Kurt M Fraser
- Department of Psychological & Brain Sciences, Krieger School of Arts & Sciences, Johns Hopkins University, Baltimore, MD, 21218, USA.
- Department of Molecular and Cell Biology, University of California Berkeley, Berkeley, CA, 94720, USA.
| | - Patricia H Janak
- Department of Psychological & Brain Sciences, Krieger School of Arts & Sciences, Johns Hopkins University, Baltimore, MD, 21218, USA
- Solomon H. Snyder Department of Neuroscience, Johns Hopkins School of Medicine, Baltimore, MD, 21205, USA
- Kavli Neuroscience Discovery Institute, Johns Hopkins School of Medicine, Baltimore, MD, 21205, USA
| |
Collapse
|
17
|
Collins V, Bornhoft KN, Wolff A, Sinha S, Saunders BT. Hierarchical cue control of cocaine seeking in the face of cost. Psychopharmacology (Berl) 2023; 240:461-476. [PMID: 36069951 PMCID: PMC10131580 DOI: 10.1007/s00213-022-06218-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Accepted: 08/22/2022] [Indexed: 12/30/2022]
Abstract
RATIONALE Addiction is characterized by intermittent drug seeking despite rising costs. This behavior is heavily influenced by environmental stimuli that signal drug availability and reinforce drug seeking. OBJECTIVE To establish the relationship between three key aspects of human drug use in rats: the intermittent, binge nature of drug intake, the motivational conflict of drug seeking in the face of escalating negative costs, and the ability of different drug cues to interact to modulate relapse. METHODS Male and female rats were trained to self-administer cocaine on an intermittent access schedule, where brief drug-availability states were signaled by a shift in the ambient lighting of the environment, and cocaine infusions were signaled by a separate proximal discrete cue. Rats then went through a conflict procedure, where foot shock intensity associated with cocaine seeking was escalated until intake was suppressed. We then completed relapse tests where the drug-delivery cue was noncontingently presented alone, or in the context of dynamic drug-availability state transitions. RESULTS Intermittent access spurred psychomotor sensitization and binge-like cocaine intake. The intensity of binge-like drug taking during training was predictive of later drug seeking despite escalating costs during conflict. In relapse tests, the ability of a proximal discrete drug cue to trigger relapse was gated by the presence of a global cue signaling drug-availability state transitions. CONCLUSIONS Our results suggest that the pattern of drug intake plays a role in many features of addiction, including modifying an individual's willingness to endure high costs associated with drug seeking. Furthermore, our studies indicate that drug-related sensory information can be hierarchically organized to exert a dynamic modulating influence on drug-seeking motivation.
Collapse
Affiliation(s)
- Val Collins
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Medical Discovery Team On Addiction, University of Minnesota, Minneapolis, MN, USA
- University of California, San Francisco, CA, USA
| | - Kaisa N Bornhoft
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Medical Discovery Team On Addiction, University of Minnesota, Minneapolis, MN, USA
| | - Amy Wolff
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
- Medical Discovery Team On Addiction, University of Minnesota, Minneapolis, MN, USA
| | - Sonal Sinha
- Johns Hopkins University, Baltimore, MD, USA
| | - Benjamin T Saunders
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA.
- Medical Discovery Team On Addiction, University of Minnesota, Minneapolis, MN, USA.
| |
Collapse
|
18
|
Brown A, Villaruel FR, Chaudhri N. Neural correlates of recall and extinction in a rat model of appetitive Pavlovian conditioning. Behav Brain Res 2023; 440:114248. [PMID: 36496079 DOI: 10.1016/j.bbr.2022.114248] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 11/30/2022] [Accepted: 12/04/2022] [Indexed: 12/12/2022]
Abstract
Extinction is a fundamental form of inhibitory learning that is important for adapting to changing environmental contingencies. While numerous studies have investigated the neural correlates of extinction using Pavlovian fear conditioning and appetitive operant reward-seeking procedures, less is known about the neural circuitry mediating the extinction of appetitive Pavlovian responding. Here, we aimed to generate an extensive brain activation map of extinction learning in a rat model of appetitive Pavlovian conditioning. Male Long-Evans rats were trained to associate a conditioned stimulus (CS; 20 s white noise) with the delivery of a 10% sucrose unconditioned stimulus (US; 0.3 ml/CS) to a fluid port. Control groups also received CS presentations, but sucrose was delivered either during the inter-trial interval or in the home-cage. After conditioning, 1 or 6 extinction sessions were conducted in which the CS was presented but sucrose was withheld. We performed Fos immunohistochemistry and network connectivity analyses on a set of cortical, striatal, thalamic, and amygdalar brain regions. Neural activity in the prelimbic cortex, ventral orbitofrontal cortex, nucleus accumbens core, and paraventricular nucleus of the thalamus was greater during recall relative to extinction. Conversely, prolonged extinction following 6 sessions induced increased neural activity in the infralimbic cortex, medial orbitofrontal cortex, and nucleus accumbens shell compared to home-cage controls. All these structures were similarly recruited during recall on the first extinction session. These findings provide novel evidence for the contribution of brain areas and neural networks that are differentially involved in the recall versus extinction of appetitive Pavlovian conditioned responding.
Collapse
Affiliation(s)
- Alexa Brown
- Center for Studies in Behavioural Neurobiology, Department of Psychology, Concordia University, Montreal, QC, Canada.
| | - Franz R Villaruel
- Center for Studies in Behavioural Neurobiology, Department of Psychology, Concordia University, Montreal, QC, Canada
| | - Nadia Chaudhri
- Center for Studies in Behavioural Neurobiology, Department of Psychology, Concordia University, Montreal, QC, Canada
| |
Collapse
|
19
|
Zbozinek TD, Perez OD, Wise T, Fanselow M, Mobbs D. Ambiguity drives higher-order Pavlovian learning. PLoS Comput Biol 2022; 18:e1010410. [PMID: 36084131 PMCID: PMC9491594 DOI: 10.1371/journal.pcbi.1010410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2021] [Revised: 09/21/2022] [Accepted: 07/19/2022] [Indexed: 11/18/2022] Open
Abstract
In the natural world, stimulus-outcome associations are often ambiguous, and most associations are highly complex and situation-dependent. Learning to disambiguate these complex associations to identify which specific outcomes will occur in which situations is critical for survival. Pavlovian occasion setters are stimuli that determine whether other stimuli will result in a specific outcome. Occasion setting is a well-established phenomenon, but very little investigation has been conducted on how occasion setters are disambiguated when they themselves are ambiguous (i.e., when they do not consistently signal whether another stimulus will be reinforced). In two preregistered studies, we investigated the role of higher-order Pavlovian occasion setting in humans. We developed and tested the first computational model predicting direct associative learning, traditional occasion setting (i.e., 1st-order occasion setting), and 2nd-order occasion setting. This model operationalizes stimulus ambiguity as a mechanism to engage in higher-order Pavlovian learning. Both behavioral and computational modeling results suggest that 2nd-order occasion setting was learned, as evidenced by lack and presence of transfer of occasion setting properties when expected and the superior fit of our 2nd-order occasion setting model compared to the 1st-order occasion setting or direct associations models. These results provide a controlled investigation into highly complex associative learning and may ultimately lead to improvements in the treatment of Pavlovian-based mental health disorders (e.g., anxiety disorders, substance use).
Collapse
Affiliation(s)
- Tomislav D. Zbozinek
- California Institute of Technology, Humanities and Social Sciences, Pasadena, California, United States of America
| | - Omar D. Perez
- California Institute of Technology, Humanities and Social Sciences, Pasadena, California, United States of America
- University of Santiago, CESS-Santiago, Faculty of Business and Economics, Santiago, Chile
- University of Chile, Department of Industrial Engineering, Santiago, Chile
| | - Toby Wise
- California Institute of Technology, Humanities and Social Sciences, Pasadena, California, United States of America
| | - Michael Fanselow
- University of California, Los Angeles, Department of Psychology, Los Angeles, California, United States of America
- University of California, Los Angeles, Department of Psychiatry & Biobehavioral Sciences, Los Angeles, California, United States of America
- University of California, Los Angeles, Staglin Center for Brain and Behavioral Health, Los Angeles, California, United States of America
- University of California, Los Angeles, Brain Research Institute, Los Angeles, California, United States of America
| | - Dean Mobbs
- California Institute of Technology, Humanities and Social Sciences, Pasadena, California, United States of America
- California Institute of Technology, Computation and Neural Systems Program, Pasadena, California, United States of America
| |
Collapse
|
20
|
Spontaneous recovery from overexpectation in an insect. Sci Rep 2022; 12:9827. [PMID: 35701655 PMCID: PMC9198028 DOI: 10.1038/s41598-022-13800-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 05/27/2022] [Indexed: 11/28/2022] Open
Abstract
In associative learning in mammals, it is widely accepted that learning is determined by the prediction error, i.e., the error between the actual reward and the reward predicted by the animal. However, it is unclear whether error-based learning theories are applicable to the learning occurring in other non-mammalian species. Here, we examined whether overexpectation, a phenomenon that supports error-based learning theories, occurs in crickets. Crickets were independently trained with two different conditioned stimuli (CSs), an odour and a visual pattern, that were followed by an appetitive unconditioned stimulus (US). Then the two CSs were presented simultaneously as a compound, followed by the same US. This treatment resulted in a reduced conditioned response to the odour CS when tested immediately after training. However, the response to the CS was partially recovered after 1 day. These results are the first to show overexpectation and its spontaneous recovery in an invertebrate species. While the results showing overexpectation are in agreement with the prediction by the Rescorla-Wagner model, a major form of error-based learning theories, the ones showing spontaneous recovery are not. Our results suggest that conventional error-based learning models account for some, but not for all essential features of Pavlovian conditioning in crickets.
Collapse
|
21
|
Gmaz JM, van der Meer MAA. Context coding in the mouse nucleus accumbens modulates motivationally relevant information. PLoS Biol 2022; 20:e3001338. [PMID: 35486662 PMCID: PMC9094556 DOI: 10.1371/journal.pbio.3001338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 05/11/2022] [Accepted: 04/04/2022] [Indexed: 11/18/2022] Open
Abstract
Neural activity in the nucleus accumbens (NAc) is thought to track fundamentally value-centric quantities linked to reward and effort. However, the NAc also contributes to flexible behavior in ways that are difficult to explain based on value signals alone, raising the question of if and how nonvalue signals are encoded in NAc. We recorded NAc neural ensembles while head-fixed mice performed an odor-based biconditional discrimination task where an initial discrete cue modulated the behavioral significance of a subsequently presented reward-predictive cue. We extracted single-unit and population-level correlates related to the cues and found value-independent coding for the initial, context-setting cue. This context signal occupied a population-level coding space orthogonal to outcome-related representations and was predictive of subsequent behaviorally relevant responses to the reward-predictive cues. Together, these findings support a gating model for how the NAc contributes to behavioral flexibility and provide a novel population-level perspective from which to view NAc computations.
Collapse
Affiliation(s)
- Jimmie M. Gmaz
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, United States of America
| | - Matthijs A. A. van der Meer
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, United States of America
- * E-mail:
| |
Collapse
|
22
|
Riley AL, Manke HN, Huang S. Impact of the Aversive Effects of Drugs on Their Use and Abuse. Behav Neurol 2022; 2022:8634176. [PMID: 35496768 PMCID: PMC9045991 DOI: 10.1155/2022/8634176] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2021] [Revised: 01/16/2022] [Accepted: 03/30/2022] [Indexed: 12/14/2022] Open
Abstract
Drug use and abuse are complex issues in that the basis of each may involve different determinants and consequences, and the transition from one to the other may be equally multifaceted. A recent model of the addiction cycle (as proposed by Koob and his colleagues) illustrates how drug-taking patterns transition from impulsive (acute use) to compulsive (chronic use) as a function of various neuroadaptations leading to the downregulation of DA systems, upregulation of stress systems, and the dysregulation of the prefrontal/orbitofrontal cortex. Although the nature of reinforcement in the initiation and mediation of these effects may differ (positive vs. negative), the role of reinforcement in drug intake (acute and chronic) is well characterized. However, drugs of abuse have other stimulus properties that may be important in their use and abuse. One such property is their aversive effects that limit drug intake instead of initiating and maintaining it. Evidence of such effects comes from both clinical and preclinical populations. In support of this position, the present review describes the aversive effects of drugs (assessed primarily in conditioned taste aversion learning), the fact that they occur concurrently with reward as assessed in combined taste aversion/place preference designs, the role of aversive effects in drug-taking (in balance with their rewarding effects), the dissociation of these affective properties in that they can be affected in different ways by the same manipulations, and the impact of various parametric, experiential, and subject factors on the aversive effects of drugs and the consequent impact of these factors on their use and abuse potential.
Collapse
Affiliation(s)
- Anthony L. Riley
- Psychopharmacology Laboratory, Department of Neuroscience, Center for Neuroscience and Behavior, American University, 4400 Massachusetts Ave NW, Washington, D.C. 20016, USA
| | - Hayley N. Manke
- Psychopharmacology Laboratory, Department of Neuroscience, Center for Neuroscience and Behavior, American University, 4400 Massachusetts Ave NW, Washington, D.C. 20016, USA
| | - Shihui Huang
- Psychopharmacology Laboratory, Department of Neuroscience, Center for Neuroscience and Behavior, American University, 4400 Massachusetts Ave NW, Washington, D.C. 20016, USA
| |
Collapse
|
23
|
Wong AH, Wirth FM, Pittig A. Avoidance of learnt fear: Models, potential mechanisms, and future directions. Behav Res Ther 2022; 151:104056. [DOI: 10.1016/j.brat.2022.104056] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2021] [Revised: 01/31/2022] [Accepted: 02/07/2022] [Indexed: 12/21/2022]
|
24
|
Howland JG, Ito R, Lapish CC, Villaruel FR. The rodent medial prefrontal cortex and associated circuits in orchestrating adaptive behavior under variable demands. Neurosci Biobehav Rev 2022; 135:104569. [PMID: 35131398 PMCID: PMC9248379 DOI: 10.1016/j.neubiorev.2022.104569] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2021] [Revised: 12/17/2021] [Accepted: 02/01/2022] [Indexed: 11/28/2022]
Abstract
Emerging evidence implicates rodent medial prefrontal cortex (mPFC) in tasks requiring adaptation of behavior to changing information from external and internal sources. However, the computations within mPFC and subsequent outputs that determine behavior are incompletely understood. We review the involvement of mPFC subregions, and their projections to the striatum and amygdala in two broad types of tasks in rodents: 1) appetitive and aversive Pavlovian and operant conditioning tasks that engage mPFC-striatum and mPFC-amygdala circuits, and 2) foraging-based tasks that require decision making to optimize reward. We find support for region-specific function of the mPFC, with dorsal mPFC and its projections to the dorsomedial striatum supporting action control with higher cognitive demands, and ventral mPFC engagement in translating affective signals into behavior via discrete projections to the ventral striatum and amygdala. However, we also propose that defined mPFC subdivisions operate as a functional continuum rather than segregated functional units, with crosstalk that allows distinct subregion-specific inputs (e.g., internal, affective) to influence adaptive behavior supported by other subregions.
Collapse
Affiliation(s)
- John G Howland
- Department of Anatomy, Physiology, and Pharmacology, University of Saskatchewan, Saskatoon, SK, Canada.
| | - Rutsuko Ito
- Department of Psychology, University of Toronto-Scarborough, Toronto, ON, Canada.
| | - Christopher C Lapish
- Department of Psychology, Indiana University-Purdue University Indianapolis, Indianapolis, IN, USA.
| | - Franz R Villaruel
- Department of Psychology, Concordia University, Montreal, QC, Canada.
| |
Collapse
|
25
|
Thrailkill EA, Alcalá JA. Relapse after incentivized choice treatment in humans: A laboratory model for studying behavior change. Exp Clin Psychopharmacol 2022; 30:220-234. [PMID: 33507769 PMCID: PMC8363208 DOI: 10.1037/pha0000443] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
Behavior change interventions that incentivize desired behavior are highly effective for improving personal health, but difficult to maintain long term. Relapse is common and examining the mechanisms that contribute to relapse in experimental settings can identify processes relevant to substance abuse treatment. We developed a laboratory task that parallels a recent operant model of relapse after incentivized choice reported in the rodent laboratory. In two experiments, undergraduate participants first learned to make an operant response (keyboard button; R1) to earn a reinforcer consisting of an image of a preferred snack food (O1). In a second phase (Phase 2), R1 was still reinforced, but a new response (R2) was introduced and reinforced with a different reinforcer (a coin; O2). In a test phase, contingent incentives for R2 were removed (extinction) and relapse of R1 was assessed. Experiment 1 found that the O2 contingency suppressed R1 during Phase 2, and R1 relapsed rapidly in the test. Neither effect was consistently related to O2 value. Experiment 2 examined whether noncontingent presentations of O1 or O2 during the test could weaken relapse. Here, we found that noncontingent reinforcers did little to reduce or slow the increase in R1 responding. The present experiments highlight a laboratory approach to studying variables that may influence relapse after incentivized treatment. We identify and discuss areas for development to address differences between the present results and prior observations from animal and clinical studies. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
Affiliation(s)
| | - José A. Alcalá
- Department of Neuroscience, Psychology and Behaviour, University of Leicester,Department of Psychology, University of Jaén
| |
Collapse
|
26
|
Craske M, Treanor M, Zbozinek T, Vervliet B. Optimizing exposure therapy with an inhibitory retrieval approach and the OptEx Nexus. Behav Res Ther 2022; 152:104069. [DOI: 10.1016/j.brat.2022.104069] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Revised: 01/12/2022] [Accepted: 02/24/2022] [Indexed: 01/05/2023]
|
27
|
Desrochers SS, Spring MG, Nautiyal KM. A Role for Serotonin in Modulating Opposing Drive and Brake Circuits of Impulsivity. Front Behav Neurosci 2022; 16:791749. [PMID: 35250501 PMCID: PMC8892181 DOI: 10.3389/fnbeh.2022.791749] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 01/11/2022] [Indexed: 12/15/2022] Open
Abstract
Impulsivity generally refers to a deficit in inhibition, with a focus on understanding the neural circuits which constitute the “brake” on actions and gratification. It is likely that increased impulsivity can arise not only from reduced inhibition, but also from a heightened or exaggerated excitatory “drive.” For example, an action which has more vigor, or is fueled by either increased incentive salience or a stronger action-outcome association, may be harder to inhibit. From this perspective, this review focuses on impulse control as a competition over behavioral output between an initially learned response-reward outcome association, and a subsequently acquired opposing inhibitory association. Our goal is to present a synthesis of research from humans and animal models that supports this dual-systems approach to understanding the behavioral and neural substrates that contribute to impulsivity, with a focus on the neuromodulatory role of serotonin. We review evidence for the role of serotonin signaling in mediating the balance of the “drive” and “brake” circuits. Additionally, we consider parallels of these competing instrumental systems in impulsivity within classical conditioning processes (e.g., extinction) in order to point us to potential behavioral and neural mechanisms that may modulate the competing instrumental associations. Finally, we consider how the balance of these competing associations might contribute to, or be extracted from, our experimental assessments of impulsivity. A careful understanding of the underlying behavioral and circuit level contributions to impulsivity is important for understanding the pathogenesis of increased impulsivity present in a number of psychiatric disorders. Pathological levels of impulsivity in such disorders are likely subserved by deficits in the balance of motivational and inhibitory processes.
Collapse
|
28
|
Villaruel FR, Martins M, Chaudhri N. Corticostriatal Suppression of Appetitive Pavlovian Conditioned Responding. J Neurosci 2022; 42:834-849. [PMID: 34880119 PMCID: PMC8808725 DOI: 10.1523/jneurosci.1664-21.2021] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2021] [Revised: 09/29/2021] [Accepted: 10/09/2021] [Indexed: 11/21/2022] Open
Abstract
The capacity to suppress learned responses is essential for animals to adapt in dynamic environments. Extinction is a process by which animals learn to suppress conditioned responding when an expected outcome is omitted. The infralimbic (IL) cortex to nucleus accumbens shell (NAcS) neural circuit is implicated in suppressing conditioned responding after extinction, especially in the context of operant cocaine-seeking behavior. However, the role of the IL-to-NAcS neural circuit in the extinction of responding to appetitive Pavlovian cues is unknown, and the psychological mechanisms involved in response suppression following extinction are unclear. We trained male Long Evans rats to associate a 10 s auditory conditioned stimulus (CS; 14 trials per session) with a sucrose unconditioned stimulus (US; 0.2 ml per CS) in a specific context, and then following extinction in a different context, precipitated a renewal of CS responding by presenting the CS alone in the original Pavlovian conditioning context. Unilateral, optogenetic stimulation of the IL-to-NAcS circuit selectively during CS trials suppressed renewal. In a separate experiment, IL-to-NAcS stimulation suppressed CS responding regardless of prior extinction and impaired extinction retrieval. Finally, IL-to-NAcS stimulation during the CS did not suppress the acquisition of Pavlovian conditioning but was required for the subsequent expression of CS responding. These results are consistent with multiple studies showing that the IL-to-NAcS neural circuit is involved in the suppression of operant cocaine-seeking, extending these findings to appetitive Pavlovian cues. The suppression of appetitive Pavlovian responding following IL-to-NAcS circuit stimulation, however, does not appear to be an extinction-dependent process.SIGNIFICANCE STATEMENT Extinction is a form of inhibitory learning through which animals learn to suppress conditioned responding in the face of nonreinforcement. We investigated the role of the IL cortex inputs to the NAcS in the extinction of responding to appetitive Pavlovian cues and the psychological mechanisms involved in response suppression following extinction. Using in vivo optogenetics, we found that stimulating the IL-to-NAcS neural circuit suppressed context-induced renewal of conditioned responding after extinction. In a separate experiment, stimulating the IL-to-NAcS circuit suppressed conditioned responding in an extinction-independent manner. These findings can be used by future research aimed at understanding how corticostriatal circuits contribute to behavioral flexibility and mental disorders that involve the suppression of learned behaviors.
Collapse
Affiliation(s)
- Franz R Villaruel
- Center for Studies in Behavioral Neurobiology, Department of Psychology, Concordia University, Montreal, Quebec H4B 1R6, Canada
| | - Melissa Martins
- Center for Studies in Behavioral Neurobiology, Department of Psychology, Concordia University, Montreal, Quebec H4B 1R6, Canada
| | - Nadia Chaudhri
- Center for Studies in Behavioral Neurobiology, Department of Psychology, Concordia University, Montreal, Quebec H4B 1R6, Canada
| |
Collapse
|
29
|
Gerhard DM, Meyer HC. Extinction trial spacing across days differentially impacts fear regulation in adult and adolescent male mice. Neurobiol Learn Mem 2021; 186:107543. [PMID: 34748926 PMCID: PMC8744067 DOI: 10.1016/j.nlm.2021.107543] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Revised: 10/15/2021] [Accepted: 10/25/2021] [Indexed: 01/09/2023]
Abstract
Fear regulation changes as a function of age and adolescence is a key developmental period for the continued maturation of fear neural circuitry. A consistent finding in the literature is diminished extinction retention in adolescents. However, these studies often directly compare adolescents to adults using a single protocol and therefore provide little insight into learning parameters that improve adolescent fear regulation. Studies in adults highlight the benefits of spaced learning over massed learning. These findings have been extended to fear regulation, with adult rodents exhibiting improved extinction learning and retention when cues are distributed over days versus a single session. However, similar studies have not been performed in adolescents. Here, we systematically examine the impact of trial spacing across days on fear regulation. Adolescent or adult male mice were exposed to one of three extinction paradigms that presented the same number of trials but differed in the temporal distribution of trials across days (one day, two days, or four days). We found that introducing consolidation events into the protocol improves adult extinction learning and short-term extinction retention but these effects disappear after two weeks. For adolescents, all three protocols were comparably effective in reducing freezing across extinction training and improved retention at both short-term and long-term fear recall time points relative to extinction-naive mice. These findings suggest that extinction protocols that incorporate consolidation events are optimal for adults but additional booster training may be required for enduring efficacy. In contrast, protocols incorporating either massed or spaced presentations show immediate and enduring benefits for adolescents.
Collapse
Affiliation(s)
- Danielle M Gerhard
- Department of Psychiatry, Weill Cornell Medicine, New York, NY, United States.
| | - Heidi C Meyer
- Department of Psychiatry, Weill Cornell Medicine, New York, NY, United States; Department of Psychological and Brain Sciences, Boston University, Boston, MA, United States.
| |
Collapse
|
30
|
Andreatta M, Pauli P. Contextual modulation of conditioned responses in humans: A review on virtual reality studies. Clin Psychol Rev 2021; 90:102095. [PMID: 34763127 DOI: 10.1016/j.cpr.2021.102095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Revised: 10/04/2021] [Accepted: 10/04/2021] [Indexed: 10/20/2022]
Abstract
Conditioned response (CRs) triggered by stimuli predicting aversive consequences have been confirmed across various species including humans, and were found to be exaggerated in anxious individuals and anxiety disorder patients. Importantly, contextual information may strongly modulate such conditioned responses (CR), however, there are several methodological boundaries in the translation of animal findings to humans, and from healthy individuals to patients. Virtual Reality (VR) is a useful technological tool for overcoming such boundaries. In this review, we summarize and evaluate human VR conditioning studies exploring the role of the context as conditioned stimulus or occasion setter for CRs. We observe that VR allows successful acquisition of conditioned anxiety and conditioned fear in response to virtual contexts and virtual cues, respectively. VR studies also revealed that spatial or temporal contextual information determine whether conditioned anxiety and conditioned fear become extinguished and/or return. Novel contexts resembling the threatening context foster conditioned fear but not conditioned anxiety, suggesting distinct context-related generalization processes. We conclude VR contexts are able to strongly modulate CRs and therefore allow a comprehensive investigation of the modulatory role of the context over CR in humans leading to conclusions relevant for non-VR and clinical studies.
Collapse
Affiliation(s)
- Marta Andreatta
- Department of Psychology (Biological Psychology, Clinical Psychology and Psychotherapy), University of Würzburg, Würzburg, Germany; Department of Psychology, Educational Sciences, and Child Studies, Erasmus University Rotterdam, the Netherlands.
| | - Paul Pauli
- Department of Psychology (Biological Psychology, Clinical Psychology and Psychotherapy), University of Würzburg, Würzburg, Germany; Center of Mental Health, University of Würzburg, Würzburg, Germany.
| |
Collapse
|
31
|
Campese VD, Brannigan LA, LeDoux JE. Conditional Control of Instrumental Avoidance by Context Following Extinction. Front Behav Neurosci 2021; 15:730113. [PMID: 34650411 PMCID: PMC8505733 DOI: 10.3389/fnbeh.2021.730113] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Accepted: 08/31/2021] [Indexed: 11/17/2022] Open
Abstract
Using rodents, three training arrangements (i.e., ABB vs. ABA, AAA vs. AAB and ABB vs. ABC) explored whether extinction influences the expression of avoidance in a manner controlled by context. Retention testing following extinction showed that more avoidance responding (i.e., renewal) was observed when extinguished cues were tested outside of the context where they had undergone extinction. In contrast, response rates were significantly lower when stimuli were tested within the context where extinction learning had occurred. These findings add to the emerging literature assessing the role of Pavlovian extinction processes in the development of instrumental avoidance responding by demonstrating conditional control over extinguished responding by context. This study was conducted using a within-subjects approach that minimized the potential for context-outcome associations to bias responding, and thus, reflects hierarchical control over behavior based on the specific associative status of each tested cue in each training context.
Collapse
Affiliation(s)
- Vincent D Campese
- Department of Psychology, University of Evansville, Evansville, IN, United States
| | - Lauren A Brannigan
- Center for Neural Science, New York University, New York, NY, United States
| | - Joseph E LeDoux
- Center for Neural Science, New York University, New York, NY, United States.,Emotional Brain Institute, Nathan Kline Institute for Psychiatric Research, Orangeburg, NY, United States
| |
Collapse
|
32
|
Zbozinek TD, Wise T, Perez OD, Qi S, Fanselow MS, Mobbs D. Pavlovian occasion setting in human fear and appetitive conditioning: Effects of trait anxiety and trait depression. Behav Res Ther 2021; 147:103986. [PMID: 34740100 DOI: 10.1016/j.brat.2021.103986] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Revised: 08/19/2021] [Accepted: 10/05/2021] [Indexed: 02/08/2023]
Abstract
Contexts and discrete stimuli often hierarchically influence the association between a stimulus and outcome. This phenomenon, called occasion setting, is central to modulation-based Pavlovian learning. We conducted two experiments with humans in fear and appetitive conditioning paradigms, training stimuli in differential conditioning, feature-positive discriminations, and feature-negative discriminations. We also investigated the effects of trait anxiety and trait depression on these forms of learning. Results from both experiments showed that participants were able to successfully learn which stimuli predicted the electric shock and monetary reward outcomes. Additionally, as hypothesized, the stimuli trained as occasion setters had little-to-no effect on simple reinforced or non-reinforced stimuli, suggesting the former were indeed occasion setters. Lastly, in fear conditioning, trait anxiety was associated with increases in fear of occasion setter/conditional stimulus compounds; in appetitive conditioning, trait depression was associated with lower expectations of monetary reward for the trained negative occasion setting compound and transfer of the negative occasion setter to the simple reinforced stimulus. These results suggest that clinically anxious individuals may have enhanced fear of occasion setting compounds, and clinically depressed individuals may expect less reward with compounds involving the negative occasion setter.
Collapse
Affiliation(s)
- Tomislav D Zbozinek
- California Institute of Technology, Humanities and Social Sciences, 1200 E. California Blvd., MC 228-77, Pasadena, CA, 91125, USA.
| | - Toby Wise
- California Institute of Technology, Humanities and Social Sciences, 1200 E. California Blvd., MC 228-77, Pasadena, CA, 91125, USA
| | - Omar D Perez
- California Institute of Technology, Humanities and Social Sciences, 1200 E. California Blvd., MC 228-77, Pasadena, CA, 91125, USA; University of Santiago of Chile (USACH), Faculty of Business and Economics, Santiago, Chile
| | - Song Qi
- National Institute of Mental Health, 6001 Executive Boulevard, Room 6200, MSC 9663, Bethesda, MD, 20892, USA
| | - Michael S Fanselow
- University of California, Department of Psychology, 502 Portola Plaza, Los Angeles, CA, 90025, USA
| | - Dean Mobbs
- California Institute of Technology, Humanities and Social Sciences, 1200 E. California Blvd., MC 228-77, Pasadena, CA, 91125, USA
| |
Collapse
|
33
|
Peng X, Burwell RD. Beyond the hippocampus: The role of parahippocampal-prefrontal communication in context-modulated behavior. Neurobiol Learn Mem 2021; 185:107520. [PMID: 34537379 DOI: 10.1016/j.nlm.2021.107520] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Revised: 08/30/2021] [Accepted: 09/10/2021] [Indexed: 01/08/2023]
Abstract
Multiple paradigms indicate that the physical environment can influence spontaneous and learned behavior. In rodents, context-dependent behavior is putatively supported by the prefrontal cortex and the medial temporal lobe. A preponderance of the literature has targeted the role of the hippocampus. In addition to the hippocampus proper, the medial temporal lobe also comprises parahippocampal areas, including the perirhinal and postrhinal cortices. These parahippocampal areas directly connect with multiple regions in the prefrontal cortex. The function of these connections, however, is not well understood. This article first reviews the involvement of the perirhinal, postrhinal, and prefrontal cortices in context-dependent behavior in rodents. Then, based on functional and anatomical evidence, we suggest that perirhinal and postrhinal contributions to context-dependent behavior go beyond supporting context representation in the hippocampus. Specifically, we propose that the perirhinal and postrhinal cortices act as a contextual-support network that directly provides contextual and spatial information to the prefrontal cortex. In turn, the perirhinal and postrhinal cortices modulate prefrontal input to the hippocampus in the service of context-guided behavior.
Collapse
Affiliation(s)
- Xiangyuan Peng
- Department of Cognitive, Linguistic, and Psychological Sciences, Brown University, Providence, RI 02912, USA
| | - Rebecca D Burwell
- Department of Cognitive, Linguistic, and Psychological Sciences, Brown University, Providence, RI 02912, USA; Department of Neuroscience, Brown University, Providence, RI 02912, USA.
| |
Collapse
|
34
|
Recovery-from-extinction effects in an anuran amphibian: renewal effect, but no reinstatement. Anim Cogn 2021; 25:359-368. [PMID: 34468877 DOI: 10.1007/s10071-021-01558-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Revised: 08/25/2021] [Accepted: 08/27/2021] [Indexed: 10/20/2022]
Abstract
Recovery-from-extinction effects in which a conditioned response returns after extinction have been shown in mammals, birds and fish. Thus, these effects appear to be conserved among vertebrates; however, they have yet to be investigated in amphibians. Using prey catching conditioning in the fire-bellied toad (Bombina orientalis), we tested if renewal and reinstatement occurred after extinction when subjects were respectively re-exposed to the context or reinforcer used during conditioning. For renewal, a different context was used during extinction and thus renewal tests assessed if external contextual cues associated during conditioning stimulated prey catching performance. For reinstatement, the reinforcer withheld during extinction was simply delivered again prior to a test assessing if internal cues associated with recent prey consumption stimulated prey catching performance. Conditioning followed a fixed ratio 5 schedule of reinforcement, where five attempts to capture a cricket stimulus displayed on a computer screen were reinforced by delivery of a single live cricket. Performance was measured as the time to reach five prey catching attempts. A significant improvement in prey catching performance during conditioning followed by deterioration with extinction was seen in the experiments. Upon return to the context used for conditioning after extinction, toads showed a renewal effect whereby they displayed faster performance during testing compared to the end of extinction. Conversely, toads showed no reinstatement effect because pre-feeding of a cricket did not influence performance during the test that followed extinction. Reinstatement could have been lost in amphibian phylogeny due to secondary simplification of the nervous system.
Collapse
|
35
|
Han S, Hu Y, Wang L, Pei Y, Zhu Z, Qi X, Wu B. Perceived Discrimination and Symptoms of Cognitive Dysfuntion Among Middle-Age and Older Persons Living With HIV in China: A Multicenter Cross-Sectional Study of the Mediating Role of Mental Health Symptoms and Social Isolation. J Assoc Nurses AIDS Care 2021; 32:442-452. [PMID: 33927145 DOI: 10.1097/jnc.0000000000000264] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
ABSTRACT Perceived discrimination is associated with symptoms of cognitive dysfunction (SOCD) among middle-age and older persons living with HIV (PLWH). We aimed to explore how the association between perceived discrimination and SOCD was mediated by mental health symptoms and social isolation. The sample included 321 PLWH, ages 45 years and older, for a multicenter cross-sectional study. Structural equation modeling showed an acceptable model fit and a significant total indirect effect between perceived discrimination and SOCD. All three indirect effect pathways were significant, suggesting that perceived discrimination could influence SOCD through mental health symptoms, through social isolation, or through mental health symptoms and then social isolation. Our study demonstrates that perceived discrimination is a concern for the management of cognitive function among middle-age and older PLWH. Both mental health symptoms and social isolation are critical elements in the design and evaluation of interventions for promoting cognitive health.
Collapse
Affiliation(s)
- Shuyu Han
- Shuyu Han, MSN, RN, is a Doctoral Candidate, School of Nursing, Fudan University, Shanghai, China. Yan Hu, PhD, RN, FAAN, is a Professor and Dean, School of Nursing, Fudan University, Shanghai, China, and is the Director of Fudan University Centre for Evidence-based Nursing: A Joanna Briggs Institute Centre of Excellence, Shanghai, China. Lina Wang, PhD, RN, is a Professor, School of Medicine, Huzhou University, Huzhou, Zhejiang, China. Yaolin Pei, PhD, is a Postdoctoral Fellow, Rory Meyers College of Nursing, New York University, New York, New York, USA. Zheng Zhu, PhD, RN, is a Faculty Member, School of Nursing, Fudan University, Shanghai, China, and a Core Researcher of Fudan University Centre for Evidence-based Nursing: A Joanna Briggs Institute Centre of Excellence, Shanghai, China. Xiang Qi, BSN, RN, is a Doctoral Candidate, Rory Meyers College of Nursing, New York University, New York, New York, USA. Bei Wu, PhD, is the Dean's Professor in Global Health, the Director for Global Health and Aging Research, and the Director for Research, Hartford Institute for Geriatric Nursing, Rory Meyers College of Nursing, New York University, New York, New York, USA
| | | | | | | | | | | | | |
Collapse
|
36
|
Icenhour A, Petrakova L, Hazzan N, Theysohn N, Merz CJ, Elsenbruch S. When gut feelings teach the brain to fear pain: Context-dependent activation of the central fear network in a novel interoceptive conditioning paradigm. Neuroimage 2021; 238:118229. [PMID: 34082119 DOI: 10.1016/j.neuroimage.2021.118229] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 04/16/2021] [Accepted: 05/31/2021] [Indexed: 11/18/2022] Open
Abstract
The relevance of contextual factors in shaping neural mechanisms underlying visceral pain-related fear learning remains elusive. However, benign interoceptive sensations, which shape patients' clinical reality, may context-dependently become conditioned predictors of impending visceral pain. In a novel context-dependent interoceptive conditioning paradigm, we elucidated the putative role of the central fear network in the acquisition and extinction of pain-related fear induced by interoceptive cues and pain-predictive contexts. In this fMRI study involving rectal distensions as a clinically-relevant model of visceroception, N = 27 healthy men and women underwent differential conditioning. During acquisition training, visceral sensations of low intensity as conditioned stimuli (CS) predicted visceral pain as unconditioned stimulus (US) in one context (Con+), or safety from pain in another context (Con-). During extinction training, interoceptive CS remained unpaired in both contexts, which were operationalized as images of different rooms presented in the MRI scanner. Successful contextual conditioning was supported by increased negative valence of Con+ compared to Con- after acquisition training, which resolved after extinction training. Although interoceptive CS were perceived as comparatively pleasant, they induced significantly greater neural activation of the amygdala, ventromedial PFC, and hippocampus when presented in Con+, while contexts alone did not elicit differential responses. During extinction training, a shift from CS to context differentiation was observed, with enhanced responses in the amygdala, ventromedial, and ventrolateral PFC to Con+ relative to Con-, whereas no CS-induced differential activation emerged. Context-dependent interoceptive conditioning can turn benign interoceptive cues into predictors of visceral pain that recruit key regions of the fear network. This first evidence expands knowledge about learning and memory mechanisms underlying interoceptive hypervigilance and maladaptive avoidance behavior, with implications for disorders of the gut-brain axis.
Collapse
Affiliation(s)
- Adriane Icenhour
- Department of Neurology, University Hospital Essen, Hufelandstr. 55, Essen 45147, Germany.
| | - Liubov Petrakova
- Department of Medical Psychology and Medical Sociology, Ruhr University Bochum, Universitaetsstr. 150, Bochum 44801 Germany
| | - Nelly Hazzan
- Department of Neurology, University Hospital Essen, Hufelandstr. 55, Essen 45147, Germany
| | - Nina Theysohn
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, University of Duisburg-Essen, Hufelandstr. 55, Essen 45147, Germany
| | - Christian J Merz
- Institute of Cognitive Neuroscience, Department of Cognitive Psychology, Ruhr University Bochum, Universitaetsstr. 150, Bochum 44801, Germany
| | - Sigrid Elsenbruch
- Department of Neurology, University Hospital Essen, Hufelandstr. 55, Essen 45147, Germany; Department of Medical Psychology and Medical Sociology, Ruhr University Bochum, Universitaetsstr. 150, Bochum 44801 Germany
| |
Collapse
|
37
|
Evaluating Extinction, Renewal, and Resurgence of Operant Behavior in Humans with Amazon Mechanical Turk. LEARNING AND MOTIVATION 2021; 74. [PMID: 34149066 DOI: 10.1016/j.lmot.2021.101728] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Amazon Mechanical Turk (MTurk) is a crowdsourcing marketplace providing researchers with the opportunity to collect behavioral data from remote participants at a low cost. Recent research demonstrated reliable extinction effects, as well as renewal and resurgence of button pressing with MTurk participants. To further examine the generality of these findings, we replicated and extended these methods across six experiments arranging reinforcement and extinction of a target button press. In contrast to previous findings, we did not observe as reliable of decreases in button pressing during extinction (1) after training with VR or VI schedules of reinforcement, (2) in the presence or absence of context changes, or (3) with an added response cost for button pressing. However, we found that that a 1-point response cost for all button presses facilitated extinction to a greater extent than the absence of response cost. Nevertheless, we observed ABA renewal of button pressing when changing background contexts across phases and resurgence when extinguishing presses on an alternative button. Our findings suggest that MTurk could be a viable platform from which to ask and address questions about extinction and relapse processes, but further procedural refinements will be necessary to improve the replicability of control by experimental contingencies.
Collapse
|
38
|
Donoso JR, Packheiser J, Pusch R, Lederer Z, Walther T, Uengoer M, Lachnit H, Güntürkün O, Cheng S. Emergence of complex dynamics of choice due to repeated exposures to extinction learning. Anim Cogn 2021; 24:1279-1297. [PMID: 33978856 PMCID: PMC8492564 DOI: 10.1007/s10071-021-01521-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2020] [Revised: 03/27/2021] [Accepted: 04/27/2021] [Indexed: 01/12/2023]
Abstract
Extinction learning, the process of ceasing an acquired behavior in response to altered reinforcement contingencies, is not only essential for survival in a changing environment, but also plays a fundamental role in the treatment of pathological behaviors. During therapy and other forms of training involving extinction, subjects are typically exposed to several sessions with a similar structure. The effects of this repeated exposure are not well understood. Here, we studied the behavior of pigeons across several sessions of a discrimination-learning task in context A, extinction in context B, and a return to context A to test the context-dependent return of the learned responses (ABA renewal). By focusing on individual learning curves across animals, we uncovered a session-dependent variability of behavior: (1) during extinction, pigeons preferred the unrewarded alternative choice in one-third of the sessions, predominantly during the first one. (2) In later sessions, abrupt transitions of behavior at the onset of context B emerged, and (3) the renewal effect decayed as sessions progressed. We show that the observed results can be parsimoniously accounted for by a computational model based only on associative learning between stimuli and actions. Our work thus demonstrates the critical importance of studying the trial-by-trial dynamics of learning in individual sessions, and the power of “simple” associative learning processes.
Collapse
Affiliation(s)
- José R Donoso
- Institute for Neural Computation, Ruhr-Universität Bochum, Universitätstr. 150, 44801, Bochum, Germany
| | - Julian Packheiser
- Department of Biopsychology, Ruhr-Universität Bochum, Universitätstr. 150, 44801, Bochum, Germany
| | - Roland Pusch
- Department of Biopsychology, Ruhr-Universität Bochum, Universitätstr. 150, 44801, Bochum, Germany
| | - Zhiyin Lederer
- Institute for Neural Computation, Ruhr-Universität Bochum, Universitätstr. 150, 44801, Bochum, Germany
| | - Thomas Walther
- Institute for Neural Computation, Ruhr-Universität Bochum, Universitätstr. 150, 44801, Bochum, Germany
| | - Metin Uengoer
- Department of Psychology, Philipps-Universität Marburg, Gutenbergstraße 18, 35032, Marburg, Germany
| | - Harald Lachnit
- Department of Psychology, Philipps-Universität Marburg, Gutenbergstraße 18, 35032, Marburg, Germany
| | - Onur Güntürkün
- Department of Biopsychology, Ruhr-Universität Bochum, Universitätstr. 150, 44801, Bochum, Germany
| | - Sen Cheng
- Institute for Neural Computation, Ruhr-Universität Bochum, Universitätstr. 150, 44801, Bochum, Germany.
| |
Collapse
|
39
|
Bouton ME, Maren S, McNally GP. BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING. Physiol Rev 2021; 101:611-681. [PMID: 32970967 PMCID: PMC8428921 DOI: 10.1152/physrev.00016.2020] [Citation(s) in RCA: 153] [Impact Index Per Article: 51.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.
Collapse
Affiliation(s)
- Mark E Bouton
- Department of Psychological Science, University of Vermont, Burlington, Vermont
| | - Stephen Maren
- Department of Psychological and Brain Sciences and Institute for Neuroscience, Texas A&M University, College Station, Texas
| | - Gavan P McNally
- School of Psychology, University of New South Wales, Sydney, Australia
| |
Collapse
|
40
|
Xing X, Fu J, Wang H, Zheng X. Contributions of prelimbic cortex, dorsal and ventral hippocampus, and basolateral amygdala to fear return induced by elevated platform stress in rats. Brain Res 2021; 1761:147398. [PMID: 33662338 DOI: 10.1016/j.brainres.2021.147398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Revised: 02/22/2021] [Accepted: 02/23/2021] [Indexed: 11/21/2022]
Abstract
Fear relapse is a major challenge in the treatment of stress-related mental disorders. Most investigations have focused on fear return induced by stimuli associated with the initial fear learning, while little attention has been paid to fear return evoked after exposure to an unconditioned stressor. This study explored the neural mechanisms of fear return induced by elevated platform (EP) stressor in Sprague-Dawley rats initially subjected to auditory fear conditioning. The contributions of the prelimbic cortex (PL), dorsal hippocampus (DH), ventral hippocampus (VH), and basolateral amygdala (BLA) were examined by targeted bilateral intracerebral injection of the GABAA agonist muscimol after elevated platform (EP) stressor. Muscimol-induced inactivation of PL or BLA significantly impaired the return of conditioning fear, while inactivation of the DH or VH had no effect. These results suggest that fear return induced by non-associative stressor may depend on the PL and BLA but not on the hippocampus.
Collapse
Affiliation(s)
- Xiaoli Xing
- Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, PR China; School of Education Science, Henan University, Kaifeng 475004, Henan Province, PR China
| | - Juan Fu
- Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, PR China; College of Biological and Environmental Engineering, Binzhou University, Binzhou 256600, Shandong Province, PR China
| | - Hongbo Wang
- School of Education Science, Henan University, Kaifeng 475004, Henan Province, PR China
| | - Xigeng Zheng
- Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, PR China; Department of Psychology, University of Chinese Academy of Sciences, Beijing 100101, PR China.
| |
Collapse
|
41
|
Lay BPP, Khoo SYS. Associative processes in addiction relapse models: A review of their Pavlovian and instrumental mechanisms, history, and terminology. NEUROANATOMY AND BEHAVIOUR 2021. [DOI: 10.35430/nab.2021.e18] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Animal models of relapse to drug-seeking have borrowed heavily from associative learning approaches. In studies of relapse-like behaviour, animals learn to self-administer drugs then receive a period of extinction during which they learn to inhibit the operant response. Several triggers can produce a recovery of responding which form the basis of a variety of models. These include the passage of time (spontaneous recovery), drug availability (rapid reacquisition), extinction of an alternative response (resurgence), context change (renewal), drug priming, stress, and cues (reinstatement). In most cases, the behavioural processes driving extinction and recovery in operant drug self-administration studies are similar to those in the Pavlovian and behavioural literature, such as context effects. However, reinstatement in addiction studies have several differences with Pavlovian reinstatement, which have emerged over several decades, in experimental procedures, associative mechanisms, and terminology. Interestingly, in cue-induced reinstatement, drug-paired cues that are present during acquisition are omitted during lever extinction. The unextinguished drug-paired cue may limit the model’s translational relevance to cue exposure therapy and renders its underlying associative mechanisms ambiguous. We review major behavioural theories that explain recovery phenomena, with a particular focus on cue-induced reinstatement because it is a widely used model in addiction. We argue that cue-induced reinstatement may be explained by a combination of behavioural processes, including reacquisition of conditioned reinforcement and Pavlovian to Instrumental Transfer. While there are important differences between addiction studies and the behavioural literature in terminology and procedures, it is clear that understanding associative learning processes is essential for studying relapse.
Collapse
Affiliation(s)
- Belinda Po Pyn Lay
- Center for Studies in Behavioral Neurobiology/Groupe de Recherche en Neurobiologie Comportementale, Department of Psychology, Concordia University, Montreal, Canada
| | - Shaun Yon-Seng Khoo
- Department of Pharmacology and Physiology, Faculty of Medicine, Université de Montréal, Montreal, Quebec, Canada
| |
Collapse
|
42
|
Haney SD, Piazza CC, Peterson KM, Greer BD. An evaluation of a renewal-mitigation procedure for inappropriate mealtime behavior. J Appl Behav Anal 2021; 54:903-927. [PMID: 33570178 DOI: 10.1002/jaba.815] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Revised: 12/13/2020] [Accepted: 12/14/2020] [Indexed: 11/10/2022]
Abstract
Renewal, the increase in behavior during extinction following context changes, may be particularly concerning during intervention for feeding disorders because context changes are often necessary for intervention generality and maintenance (Podlesnik et al., 2017). In the current study, we tested for renewal and evaluated a renewal-mitigation procedure when we transferred intervention from a therapist to a caregiver, from clinic to the home, and changed the foods the feeder presented. We used an ABA arrangement to evaluate the generality of the renewal effect with 7 participants who engaged in inappropriate mealtime behavior. Context A was functional reinforcement. Context B was function-based extinction during the control and mitigation conditions and our renewal-mitigation procedure in the mitigation condition. The renewal test was function-based extinction in Context A. We observed renewal of inappropriate mealtime behavior in 4 of 7 participants, and our renewal-mitigation procedure was effective for 4 of 4 participants.
Collapse
Affiliation(s)
- Sarah D Haney
- University of Nebraska Medical Center's Munroe-Meyer Institute
| | | | | | - Brian D Greer
- University of Nebraska Medical Center's Munroe-Meyer Institute
| |
Collapse
|
43
|
Abstract
An instrumental action can be goal-directed after a moderate amount of practice and then convert to habit after more extensive practice. Recent evidence suggests, however, that habits can return to action status after different environmental manipulations. The present experiments therefore asked whether habit learning interferes with goal direction in a context-dependent manner like other types of retroactive interference (e.g., extinction, punishment, counterconditioning). In Experiment 1, rats were given a moderate amount of instrumental training to form an action in one context (Context A) and then more extended training of the same response to form a habit in another context (Context B). We then performed reinforcer devaluation with taste aversion conditioning in both contexts, and tested the response in both contexts. The response remained habitual in Context B, but was goal-directed in Context A, indicating renewal of goal direction after habit learning. Experiment 2 expanded on Experiment 1 by testing the response in a third context (Context C). It found that the habitual response also renewed as action in this context. Together, the results establish a parallel between habit and extinction learning: Conversion to habit does not destroy action knowledge, but interferes with it in a context-specific way. They are also consistent with other results suggesting that habit is specific to the context in which it is learned, whereas goal-direction can transfer between contexts. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
Affiliation(s)
| | - Mark E Bouton
- Department of Psychological Science, University of Vermont
| |
Collapse
|
44
|
Lawson SC, Gass JC, Cooper RK, Tonkin SS, Colder CR, Mahoney MC, Tiffany ST, Hawk LW. The impact of three weeks of pre-quit varenicline on reinforcing value and craving for cigarettes in a laboratory choice procedure. Psychopharmacology (Berl) 2021; 238:599-609. [PMID: 33219852 PMCID: PMC10031567 DOI: 10.1007/s00213-020-05713-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/10/2020] [Accepted: 11/10/2020] [Indexed: 12/16/2022]
Abstract
RATIONALE Varenicline, a partial nicotinic agonist, is theorized to attenuate pre-quit smoking reinforcement and post-quit withdrawal and craving. However, the mechanisms of action have not been fully characterized, as most studies employ only retrospective self-report measures, hypothetical indices of reinforcing value, and/or nontreatment-seeking samples. OBJECTIVES The current research examined the impact of pre-quit varenicline (vs. placebo) on laboratory measures of smoking and food (vs. water) reinforcement and craving. METHODS Participants were 162 treatment-seeking smokers enrolled in a randomized controlled trial of smoking cessation ( clinicaltrials.gov ID: NCT03262662). Participants completed two laboratory sessions: a pre-treatment session, ~ 1 week prior to beginning varenicline or placebo, and an active treatment session, after ~ 3 weeks of treatment. At each session, participants completed a laboratory choice procedure; on each of 36 trials, a lit cigarette, food item, or cup of water was randomly presented. Participants reported level of craving and spent $0.01-0.25 to have a corresponding 5-95% chance to sample the cue. RESULTS As predicted, spending was significantly higher on cigarette trials than water trials, and varenicline resulted in a greater between-session decline in spending on cigarette trials (but not water) than did placebo. Cigarette craving was enhanced in the presence of smoking cues compared to water, but neither average (tonic) cigarette craving nor cue-specific cigarette craving was significantly influenced by varenicline. Food spending and craving were generally unaffected by varenicline treatment. CONCLUSIONS These laboratory data from treatment-seeking smokers provide the strongest evidence to date that varenicline selectively attenuates smoking reinforcement prior to quitting.
Collapse
Affiliation(s)
- Schuyler C Lawson
- Department of Psychology, University at Buffalo (The State University of New York), Main Street, Buffalo, NY, 14214, USA
| | - Julie C Gass
- Department of Psychology, University at Buffalo (The State University of New York), Main Street, Buffalo, NY, 14214, USA
- Center for Integrated Healthcare, VA Western New York Healthcare System, 3495 Bailey Ave, Buffalo, NY, 14215, USA
| | - Robert K Cooper
- Department of Psychology, University at Buffalo (The State University of New York), Main Street, Buffalo, NY, 14214, USA
| | - Sarah S Tonkin
- Department of Psychology, University at Buffalo (The State University of New York), Main Street, Buffalo, NY, 14214, USA
| | - Craig R Colder
- Department of Psychology, University at Buffalo (The State University of New York), Main Street, Buffalo, NY, 14214, USA
| | - Martin C Mahoney
- Department of Psychology, University at Buffalo (The State University of New York), Main Street, Buffalo, NY, 14214, USA
- Department of Internal Medicine, Roswell Park Cancer Institute, Buffalo, NY, 14263, USA
| | - Stephen T Tiffany
- Department of Psychology, University at Buffalo (The State University of New York), Main Street, Buffalo, NY, 14214, USA
| | - Larry W Hawk
- Department of Psychology, University at Buffalo (The State University of New York), Main Street, Buffalo, NY, 14214, USA.
| |
Collapse
|
45
|
Liu C, Yücel M, Suo C, Le Pelley ME, Tiego J, Rotaru K, Fontenelle LF, Albertella L. Reward-Related Attentional Capture Moderates the Association between Fear-Driven Motives and Heavy Drinking. Eur Addict Res 2021; 27:351-361. [PMID: 33706304 DOI: 10.1159/000513470] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/11/2020] [Accepted: 11/27/2020] [Indexed: 11/19/2022]
Abstract
BACKGROUND To date, there has been little investigation on how motivational and cognitive mechanisms interact to influence problematic drinking behaviours. Towards this aim, the current study examined whether reward-related attentional capture is associated with reward, fear (relief), and habit drinking motives, and further, whether it interacts with these motives in relation to problematic drinking patterns. METHODS Ninety participants (mean age = 34.8 years, SD = 9.1, 54% male) who reported having consumed alcohol in the past month completed an online visual search task that measured reward-related attentional capture as well as the Habit Reward Fear Scale, a measure of drinking motives. Participants also completed measures of psychological distress, impulsivity, compulsive drinking, and consumption items of Alcohol Use Disorders Identification Test. Regression analyses examined the associations between motives for alcohol consumption and reward-related attentional capture, as well as the associations between reward-related attentional capture, motives, and their interaction, with alcohol consumption and problems. RESULTS Greater reward-related attentional capture was associated with greater reward motives. Further, reward-related attentional capture also interacted with fear motives in relation to alcohol consumption. Follow-up analyses showed that this interaction was driven by greater fear motives being associated with heavier drinking among those with lower reward-related attentional capture (i.e., "goal-trackers"). CONCLUSION These findings have implications for understanding how cognition may interact with motives in association with problematic drinking. Specifically, the findings highlight different potential pathways to problematic drinking according to an individual's cognitive-motivational profile and may inform tailored interventions to target profile-specific mechanisms. Finally, these findings offer support for contemporary models of addiction that view excessive goal-directed behaviour under negative affect as a critical contributor to addictive behaviours.
Collapse
Affiliation(s)
- Chang Liu
- Turner Institute for Brain and Mental Health and School of Psychological Sciences, Monash University, Clayton, Victoria, Australia
| | - Murat Yücel
- Turner Institute for Brain and Mental Health and School of Psychological Sciences, Monash University, Clayton, Victoria, Australia
| | - Chao Suo
- Turner Institute for Brain and Mental Health and School of Psychological Sciences, Monash University, Clayton, Victoria, Australia
| | - Mike E Le Pelley
- School of Psychology, UNSW, Kensington, New South Wales, Australia
| | - Jeggan Tiego
- Turner Institute for Brain and Mental Health and School of Psychological Sciences, Monash University, Clayton, Victoria, Australia
| | - Kristian Rotaru
- Turner Institute for Brain and Mental Health and School of Psychological Sciences, Monash University, Clayton, Victoria, Australia.,Monash Business School, Monash University, Caulfield, Victoria, Australia
| | - Leonardo F Fontenelle
- Turner Institute for Brain and Mental Health and School of Psychological Sciences, Monash University, Clayton, Victoria, Australia, .,Institute of Psychiatry, Obsessive, Compulsive, and Anxiety Research Program, Federal University of Rio de Janeiro, Rio de Janeiro, Brazil, .,D'Or Institute for Research and Education, Rio de Janeiro, Brazil,
| | - Lucy Albertella
- Turner Institute for Brain and Mental Health and School of Psychological Sciences, Monash University, Clayton, Victoria, Australia
| |
Collapse
|
46
|
Martínez-Rivera FJ, Sánchez-Navarro MJ, Huertas-Pérez CI, Greenberg BD, Rasmussen SA, Quirk GJ. Prolonged avoidance training exacerbates OCD-like behaviors in a rodent model. Transl Psychiatry 2020; 10:212. [PMID: 32620740 PMCID: PMC7334221 DOI: 10.1038/s41398-020-00892-5] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/07/2019] [Revised: 06/05/2020] [Accepted: 06/10/2020] [Indexed: 01/12/2023] Open
Abstract
Obsessive-compulsive disorder (OCD) is characterized by compulsive behaviors that often resemble avoidance of perceived danger. OCD can be treated with exposure-with-response prevention (ERP) therapy in which patients are exposed to triggers but are encouraged to refrain from compulsions, to extinguish compulsive responses. The compulsions of OCD are strengthened by many repeated exposures to triggers, but little is known about the effects of extended repetition of avoidance behaviors on extinction. Here we assessed the extent to which overtraining of active avoidance affects subsequent extinction-with-response prevention (Ext-RP) as a rodent model of ERP, in which rats are extinguished to triggers, while the avoidance option is prevented. Male rats conditioned for 8d or 20d produced similar avoidance behavior to a tone paired with a shock, however, the 20d group showed a severe impairment of extinction during Ext-RP, as well as heightened anxiety. Furthermore, the majority of overtrained (20d) rats (75%) exhibited persistent avoidance following Ext-RP. In the 8d group, only a minority of rats (37%) exhibited persistent avoidance, and this was associated with elevated activity (c-Fos) in the prelimbic cortex and nucleus accumbens. In the 20d group, the minority of non-persistent rats (25%) showed elevated activity in the insular-orbital cortex and paraventricular thalamus. Lastly, extending the duration of Ext-RP prevented the deleterious effects of overtraining on extinction and avoidance. These rodent findings suggest that repeated expression of compulsion-like behaviors biases individuals toward persistent avoidance and alters avoidance circuits, thereby reducing the effectiveness of current extinction-based therapies.
Collapse
Affiliation(s)
- Freddyson J Martínez-Rivera
- Departments of Psychiatry and Anatomy & Neurobiology, School of Medicine, Medical Sciences Campus, University of Puerto Rico, San Juan, PR, 00936, USA.
- Nash family Department of Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USA.
| | - Marcos J Sánchez-Navarro
- Departments of Psychiatry and Anatomy & Neurobiology, School of Medicine, Medical Sciences Campus, University of Puerto Rico, San Juan, PR, 00936, USA
| | - Carlos I Huertas-Pérez
- Departments of Psychiatry and Anatomy & Neurobiology, School of Medicine, Medical Sciences Campus, University of Puerto Rico, San Juan, PR, 00936, USA
| | - Benjamin D Greenberg
- Department of Psychiatry and Human Behavior, Alpert Medical School of Brown University and Butler Hospital and the Providence VA Medical Center, Providence, RI, 02906, USA
| | - Steven A Rasmussen
- Department of Psychiatry and Human Behavior, Alpert Medical School of Brown University and Butler Hospital and the Providence VA Medical Center, Providence, RI, 02906, USA
| | - Gregory J Quirk
- Departments of Psychiatry and Anatomy & Neurobiology, School of Medicine, Medical Sciences Campus, University of Puerto Rico, San Juan, PR, 00936, USA
| |
Collapse
|
47
|
Aquili L, Bowman EM, Schmidt R. Occasion setters determine responses of putative DA neurons to discriminative stimuli. Neurobiol Learn Mem 2020; 173:107270. [PMID: 32565408 DOI: 10.1016/j.nlm.2020.107270] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Revised: 05/20/2020] [Accepted: 06/15/2020] [Indexed: 11/16/2022]
Abstract
Midbrain dopamine (DA) neurons are involved in the processing of rewards and reward-predicting stimuli, possibly analogous to reinforcement learning reward prediction errors. Here we studied the activity of putative DA neurons (n = 37) recorded in the ventral tegmental area of rats (n = 6) performing a behavioural task involving occasion setting. In this task an occasion setter (OS) indicated that the relationship between a discriminative stimulus (DS) and reinforcement is in effect, so that reinforcement of bar pressing occurred only after the OS (tone or houselight) was followed by the DS (houselight or tone). We found that responses of putative DA cells to the DS were enhanced when preceded by the OS, as were behavioural responses to obtain rewards. Surprisingly though, we did not find a homogeneous increase in the mean activity of the population of putative DA neurons to the OS, contrary to predictions of standard temporal-difference models of DA neurons. Instead, putative DA neurons exhibited a heterogeneous response on a single unit level, so that some units increased and others decreased their activity as a response to the OS. Similarly, putative non-DA cells did not show a homogeneous response to the DS on a population level, but also had heterogeneous responses on a single unit level. The heterogeneity in the responses of neurons in the ventral tegmental area may reflect how DA neurons encode context and point to local differences in DA signalling.
Collapse
Affiliation(s)
- Luca Aquili
- School of Psychology and Neuroscience, University of St Andrews, St Mary's Quadrangle, South Street, St Andrews, Scotland KY16 9JP, UK.
| | - Eric M Bowman
- School of Psychology and Neuroscience, University of St Andrews, St Mary's Quadrangle, South Street, St Andrews, Scotland KY16 9JP, UK
| | - Robert Schmidt
- Department of Psychology, the University of Sheffield, Western Bank, Sheffield S10 2TP, UK
| |
Collapse
|
48
|
Tavakkoli A, Fournier DI, Bucci DJ, Todd TP. Reduced renewal of conditioned suppression following lesions of the dorsal hippocampus in male rats. Behav Neurosci 2020; 134:444-459. [PMID: 32525334 DOI: 10.1037/bne0000379] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Extinguished responding will renew when the conditioned stimulus occurs outside the extinction context. Although studies of conditioned freezing have consistently demonstrated a role for the hippocampus in renewal, several studies have demonstrated intact renewal of conditioned suppression despite damage to the hippocampus (Frohardt, Guarraci, & Bouton, 2000; Todd, Jiang, DeAngeli, & Bucci, 2017; Wilson, Brooks, & Bouton, 1995). Because these prior studies have examined renewal when testing occurred in the original conditioning context ("Context A"), the present conditioned suppression experiments examined the role of the hippocampus when testing occurred in a context not associated with prior conditioning ("Context C"). In Experiments 1 and 2, conditioning occurred in Context A, and extinction in Context B. Renewal of conditioned suppression was observed when the extinguished conditioned stimulus (CS) was tested in Context C. However, renewal was attenuated in rats with lesions of the dorsal hippocampus (DH). Summation testing failed to detect conditioned inhibition in the extinction context, suggesting instead that the context acquired negative occasion-setting properties. Attenuated renewal was not due to an inability of DH lesioned rats to discriminate contexts (Experiment 3). These experiments thus demonstrate a role for the DH in renewal of conditioned suppression when testing occurs in a neutral context. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
|
49
|
Steinfeld MR, Bouton ME. Context and renewal of habits and goal-directed actions after extinction. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL LEARNING AND COGNITION 2020; 46:408-421. [PMID: 32378909 DOI: 10.1037/xan0000247] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Instrumental behaviors that are goal-directed actions after moderate amounts of training can become habits after more extended training. Little research has asked how actions and habits are affected by retroactive interference treatments like extinction. The present experiments begin to fill this gap in the literature. In Experiments 1a and 1b, lever pressing in rats was minimally trained (1a) or extensively trained (1b) in one context (Context A), extinguished in a second context (Context B), and then tested in the acquisition context (Context A). Exposure to both contexts was equated and controlled throughout, and the status of the behavior as action or habit was determined by reinforcer devaluation methods (taste aversion conditioning). Results confirmed that action (1a) and habit (1b) renewed with action or habit status, respectively, when they were returned to Context A. Experiments 2a and 2b then similarly tested action and habit after extinction in an ABC renewal paradigm. Here, lever pressing that was trained in Context A and extinguished in Context B renewed as action in Context C regardless of whether it had been an action or habit before extinction. The apparent conversion of habit to action during renewal testing in Context C was consistent with other results suggesting that habits converted to action when the context was changed at the start of extinction. Together, the results suggest that extinction in a second context inhibits instrumental behaviors trained as either actions or habits in a context-specific manner. They also expand on prior findings suggesting that actions transfer across contexts, and that habits do not. A change of context may be sufficient to convert a habit to goal-directed action. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
Affiliation(s)
| | - Mark E Bouton
- Department of Psychological Science, University of Vermont
| |
Collapse
|
50
|
Miller RR, Laborda MA, Polack CW. Extinction training can make the extinction context a stimulus-specific inhibitor: A potential mechanism of experimental renewal. LEARNING AND MOTIVATION 2020; 70:101623. [PMID: 32296250 PMCID: PMC7158866 DOI: 10.1016/j.lmot.2020.101623] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Renewal is the recovery of extinguished responding to a conditioned stimulus when testing occurs outside the extinction context. Renewal has been explained as the extinction context becoming a negative occasion setter during extinction. However, other mechanisms may contribute. Two recent studies showed (a) after extinction of a discrete cue, the extinction context can serve as a conditioned inhibitor, and (b) in some circumstances operational extinction of a conditioned inhibitor can reduce inhibition with respect to a transfer excitor while retaining inhibition with respect to the excitor used in inhibitory training. Here we examine the potential contribution of these phenomena to renewal. In the present experiment, all rats received fear-conditioning with a target cue in one context and extinction of that cue in a second context. Then half of the subjects received massive extinction of the extinction context (i.e., 24 h) while the other half received only handling. Finally, some subjects in each condition were tested for responding to the target cue in the extinction context, others in a second familiar context, and yet others in a third transfer context in which another fear cue had been extinguished. The results showed ABC renewal independent of whether subjects had or had not received context extinction. However, transfer of the inhibitory potential of the extinction context was observed only in subjects that did not receive context extinction. These results suggest an extinction context can serve as a stimulus-specific conditioned inhibitor, thereby contributing to renewal by decreasing responding to the target cue in an ABB control condition.
Collapse
Affiliation(s)
- Ralph R. Miller
- Department of Psychology, State University of New York at Binghamton
| | | | - Cody W. Polack
- Department of Psychology, State University of New York at Binghamton
| |
Collapse
|