1
|
Zbozinek TD, Perez OD, Wise T, Fanselow M, Mobbs D. Ambiguity drives higher-order Pavlovian learning. PLoS Comput Biol 2022; 18:e1010410. [PMID: 36084131 PMCID: PMC9491594 DOI: 10.1371/journal.pcbi.1010410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2021] [Revised: 09/21/2022] [Accepted: 07/19/2022] [Indexed: 11/18/2022] Open
Abstract
In the natural world, stimulus-outcome associations are often ambiguous, and most associations are highly complex and situation-dependent. Learning to disambiguate these complex associations to identify which specific outcomes will occur in which situations is critical for survival. Pavlovian occasion setters are stimuli that determine whether other stimuli will result in a specific outcome. Occasion setting is a well-established phenomenon, but very little investigation has been conducted on how occasion setters are disambiguated when they themselves are ambiguous (i.e., when they do not consistently signal whether another stimulus will be reinforced). In two preregistered studies, we investigated the role of higher-order Pavlovian occasion setting in humans. We developed and tested the first computational model predicting direct associative learning, traditional occasion setting (i.e., 1st-order occasion setting), and 2nd-order occasion setting. This model operationalizes stimulus ambiguity as a mechanism to engage in higher-order Pavlovian learning. Both behavioral and computational modeling results suggest that 2nd-order occasion setting was learned, as evidenced by lack and presence of transfer of occasion setting properties when expected and the superior fit of our 2nd-order occasion setting model compared to the 1st-order occasion setting or direct associations models. These results provide a controlled investigation into highly complex associative learning and may ultimately lead to improvements in the treatment of Pavlovian-based mental health disorders (e.g., anxiety disorders, substance use).
Collapse
Affiliation(s)
- Tomislav D. Zbozinek
- California Institute of Technology, Humanities and Social Sciences, Pasadena, California, United States of America
| | - Omar D. Perez
- California Institute of Technology, Humanities and Social Sciences, Pasadena, California, United States of America
- University of Santiago, CESS-Santiago, Faculty of Business and Economics, Santiago, Chile
- University of Chile, Department of Industrial Engineering, Santiago, Chile
| | - Toby Wise
- California Institute of Technology, Humanities and Social Sciences, Pasadena, California, United States of America
| | - Michael Fanselow
- University of California, Los Angeles, Department of Psychology, Los Angeles, California, United States of America
- University of California, Los Angeles, Department of Psychiatry & Biobehavioral Sciences, Los Angeles, California, United States of America
- University of California, Los Angeles, Staglin Center for Brain and Behavioral Health, Los Angeles, California, United States of America
- University of California, Los Angeles, Brain Research Institute, Los Angeles, California, United States of America
| | - Dean Mobbs
- California Institute of Technology, Humanities and Social Sciences, Pasadena, California, United States of America
- California Institute of Technology, Computation and Neural Systems Program, Pasadena, California, United States of America
| |
Collapse
|
2
|
Zbozinek TD, Wise T, Perez OD, Qi S, Fanselow MS, Mobbs D. Pavlovian occasion setting in human fear and appetitive conditioning: Effects of trait anxiety and trait depression. Behav Res Ther 2021; 147:103986. [PMID: 34740100 DOI: 10.1016/j.brat.2021.103986] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Revised: 08/19/2021] [Accepted: 10/05/2021] [Indexed: 02/08/2023]
Abstract
Contexts and discrete stimuli often hierarchically influence the association between a stimulus and outcome. This phenomenon, called occasion setting, is central to modulation-based Pavlovian learning. We conducted two experiments with humans in fear and appetitive conditioning paradigms, training stimuli in differential conditioning, feature-positive discriminations, and feature-negative discriminations. We also investigated the effects of trait anxiety and trait depression on these forms of learning. Results from both experiments showed that participants were able to successfully learn which stimuli predicted the electric shock and monetary reward outcomes. Additionally, as hypothesized, the stimuli trained as occasion setters had little-to-no effect on simple reinforced or non-reinforced stimuli, suggesting the former were indeed occasion setters. Lastly, in fear conditioning, trait anxiety was associated with increases in fear of occasion setter/conditional stimulus compounds; in appetitive conditioning, trait depression was associated with lower expectations of monetary reward for the trained negative occasion setting compound and transfer of the negative occasion setter to the simple reinforced stimulus. These results suggest that clinically anxious individuals may have enhanced fear of occasion setting compounds, and clinically depressed individuals may expect less reward with compounds involving the negative occasion setter.
Collapse
Affiliation(s)
- Tomislav D Zbozinek
- California Institute of Technology, Humanities and Social Sciences, 1200 E. California Blvd., MC 228-77, Pasadena, CA, 91125, USA.
| | - Toby Wise
- California Institute of Technology, Humanities and Social Sciences, 1200 E. California Blvd., MC 228-77, Pasadena, CA, 91125, USA
| | - Omar D Perez
- California Institute of Technology, Humanities and Social Sciences, 1200 E. California Blvd., MC 228-77, Pasadena, CA, 91125, USA; University of Santiago of Chile (USACH), Faculty of Business and Economics, Santiago, Chile
| | - Song Qi
- National Institute of Mental Health, 6001 Executive Boulevard, Room 6200, MSC 9663, Bethesda, MD, 20892, USA
| | - Michael S Fanselow
- University of California, Department of Psychology, 502 Portola Plaza, Los Angeles, CA, 90025, USA
| | - Dean Mobbs
- California Institute of Technology, Humanities and Social Sciences, 1200 E. California Blvd., MC 228-77, Pasadena, CA, 91125, USA
| |
Collapse
|
3
|
Assessing the blocking of occasion setting. Behav Processes 2018; 154:52-59. [PMID: 29444454 DOI: 10.1016/j.beproc.2018.02.008] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2017] [Revised: 02/09/2018] [Accepted: 02/10/2018] [Indexed: 11/21/2022]
Abstract
An occasion setter (OS) is a stimulus or context with the capacity to disambiguate an ambiguous conditioned stimulus (CS). Previous research has shown that OSs share some features with regular Pavlovian CSs. Amongst them, research has shown that OSs are subject to blocking; that is, a new OS exerts reduced behavioral control after training in compound with a previously established OS. Of additional interest, in Pavlovian blocking, it has been reported that a blocked CS comes to elicit conditioned responding after the extinction of the blocking CS. This is an example of retrospective revaluation, a family of phenomena in which the response to a specific stimulus is modified by training a related cue. Here, three experiments sought to extend the analogies between OS and Pavlovian conditioning by examining the blocking of OSs and its retrospective revaluation. In all experiments, an OS was established by pairing a CS with food in the presence of the OS, but not in its absence (i.e., positive OS). Blocking was then trained by presenting the OS in compound with a novel OS. Experiment 1 showed blocking of the second OS, but direct exposure to the blocking OS did not enhance responding to the second OS. Experiment 2 replicated the blocking effect but subsequent training of the blocking OS with a reversed contingency showed no retrospective revaluation. Experiment 3 examined whether blocking of the OS occurred with a novel CS during the compound phase. In this experiment blocking was again observed, but only when subjects were tested with the original CS. These results are discussed focusing on the underlying links at work in occasion setting.
Collapse
|