1
|
Charpentier CJ, Wu Q, Min S, Ding W, Cockburn J, O'Doherty JP. Heterogeneity in strategy use during arbitration between experiential and observational learning. Nat Commun 2024; 15:4436. [PMID: 38789415 PMCID: PMC11126711 DOI: 10.1038/s41467-024-48548-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Accepted: 05/06/2024] [Indexed: 05/26/2024] Open
Abstract
To navigate our complex social world, it is crucial to deploy multiple learning strategies, such as learning from directly experiencing action outcomes or from observing other people's behavior. Despite the prevalence of experiential and observational learning in humans and other social animals, it remains unclear how people favor one strategy over the other depending on the environment, and how individuals vary in their strategy use. Here, we describe an arbitration mechanism in which the prediction errors associated with each learning strategy influence their weight over behavior. We designed an online behavioral task to test our computational model, and found that while a substantial proportion of participants relied on the proposed arbitration mechanism, there was some meaningful heterogeneity in how people solved this task. Four other groups were identified: those who used a fixed mixture between the two strategies, those who relied on a single strategy and non-learners with irrelevant strategies. Furthermore, groups were found to differ on key behavioral signatures, and on transdiagnostic symptom dimensions, in particular autism traits and anxiety. Together, these results demonstrate how large heterogeneous datasets and computational methods can be leveraged to better characterize individual differences.
Collapse
Affiliation(s)
- Caroline J Charpentier
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA.
- Department of Psychology & Brain and Behavior Institute, University of Maryland, College Park, MD, USA.
| | - Qianying Wu
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA
| | - Seokyoung Min
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA
| | - Weilun Ding
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA
| | - Jeffrey Cockburn
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA
| | - John P O'Doherty
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA
| |
Collapse
|
2
|
Dinckol O, Wenger NH, Zachry JE, Kutlu MG. Nucleus accumbens core single cell ensembles bidirectionally respond to experienced versus observed aversive events. Sci Rep 2023; 13:22602. [PMID: 38114559 PMCID: PMC10730531 DOI: 10.1038/s41598-023-49686-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Accepted: 12/11/2023] [Indexed: 12/21/2023] Open
Abstract
Fear learning is a critical feature of survival skills among mammals. In rodents, fear learning manifests itself through direct experience of the aversive event or social transmission of aversive stimuli such as observing and acting on conspecifics' distress. The neuronal network underlying the social transmission of information largely overlaps with the brain regions that mediate behavioral responses to aversive and rewarding stimuli. In this study, we recorded single cell activity patterns of nucleus accumbens (NAc) core neurons using in vivo optical imaging of calcium transients via miniature scopes. This cutting-edge imaging methodology not only allows us to record activity patterns of individual neurons but also lets us longitudinally follow these individual neurons across time and different behavioral states. Using this approach, we identified NAc core single cell ensembles that respond to experienced and/or observed aversive stimuli. Our results showed that experienced and observed aversive stimuli evoke NAc core ensemble activity that is largely positive, with a smaller subset of negative responses. The size of the NAc single cell ensemble response was greater for experienced aversive stimuli compared to observed aversive events. Our results also revealed sex differences in the NAc core single cell ensembles responses to experience aversive stimuli, where females showed a greater accumbal response. Importantly, we found a subpopulation within the NAc core single cell ensembles that show a bidirectional response to experienced aversive stimuli versus observed aversive stimuli (i.e., negative response to experienced and positive response to observed). Our results suggest that the NAc plays a role in differentiating somatosensory experience from social observation of aversion at a single cell level. These results have important implications for psychopathologies where social information processing is maladaptive, such as autism spectrum disorders.
Collapse
Affiliation(s)
- Oyku Dinckol
- Department of Cell Biology and Neuroscience, Rowan-Virtua School of Translational Biomedical Engineering and Sciences, Rowan University, Stratford, NJ, 08084, USA
- Rowan-Virtua School of Osteopathic Medicine, Rowan University, Stratford, NJ, 08084, USA
| | - Noah Harris Wenger
- Department of Cell Biology and Neuroscience, Rowan-Virtua School of Translational Biomedical Engineering and Sciences, Rowan University, Stratford, NJ, 08084, USA
- Rowan-Virtua School of Osteopathic Medicine, Rowan University, Stratford, NJ, 08084, USA
| | - Jennifer E Zachry
- Department of Pharmacology, Vanderbilt University, Nashville, TN, 37232, USA
| | - Munir Gunes Kutlu
- Department of Cell Biology and Neuroscience, Rowan-Virtua School of Translational Biomedical Engineering and Sciences, Rowan University, Stratford, NJ, 08084, USA.
- Rowan-Virtua School of Osteopathic Medicine, Rowan University, Stratford, NJ, 08084, USA.
| |
Collapse
|
3
|
Ney LJ, O'Donohue M, Wang Y, Richardson M, Vasarhelyi A, Lipp OV. The next frontier: Moving human fear conditioning research online. Biol Psychol 2023; 184:108715. [PMID: 37852526 DOI: 10.1016/j.biopsycho.2023.108715] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 10/10/2023] [Accepted: 10/12/2023] [Indexed: 10/20/2023]
Abstract
Fear conditioning is a significant area of research that has featured prominently among the topics published in Biological Psychology over the last 50 years. This work has greatly contributed to our understanding of human anxiety and stressor-related disorders. While mainly conducted in the laboratory, recently, there have been initial attempts to conduct fear conditioning experiments online, with around 10 studies published on the subject, primarily in the last two years. These studies have demonstrated the potential of online fear conditioning research, although challenges to ensure that this research meets the same methodological standards as in-person experimentation remain, despite recent progress. We expect that in the coming years new outcome measures will become available online including the measurement of eye-tracking, pupillometry and probe reaction time and that compliance monitoring will be improved. This exciting new approach opens new possibilities for large-scale data collection among hard-to-reach populations and has the potential to transform the future of fear conditioning research.
Collapse
Affiliation(s)
- Luke J Ney
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia
| | - Matthew O'Donohue
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia
| | - Yi Wang
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia
| | - Mikaela Richardson
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia
| | - Adam Vasarhelyi
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia
| | - Ottmar V Lipp
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia.
| |
Collapse
|
4
|
Pan Y, Vinding MC, Zhang L, Lundqvist D, Olsson A. A Brain-To-Brain Mechanism for Social Transmission of Threat Learning. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2304037. [PMID: 37544901 PMCID: PMC10558655 DOI: 10.1002/advs.202304037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Indexed: 08/08/2023]
Abstract
Survival and adaptation in environments require swift and efficacious learning about what is dangerous. Across species, much of such threat learning is acquired socially, e.g., through the observation of others' ("demonstrators'") defensive behaviors. However, the specific neural mechanisms responsible for the integration of information shared between demonstrators and observers remain largely unknown. This dearth of knowledge is addressed by performing magnetoencephalography (MEG) neuroimaging in demonstrator-observer dyads. A set of stimuli are first shown to a demonstrator whose defensive responses are filmed and later presented to an observer, while neuronal activity is recorded sequentially from both individuals who never interacted directly. These results show that brain-to-brain coupling (BtBC) in the fronto-limbic circuit (including insula, ventromedial, and dorsolateral prefrontal cortex) within demonstrator-observer dyads predict subsequent expressions of learning in the observer. Importantly, the predictive power of BtBC magnifies when a threat is imminent to the demonstrator. Furthermore, BtBC depends on how observers perceive their social status relative to the demonstrator, likely driven by shared attention and emotion, as bolstered by dyadic pupillary coupling. Taken together, this study describes a brain-to-brain mechanism for social threat learning, involving BtBC, which reflects social relationships and predicts adaptive, learned behaviors.
Collapse
Affiliation(s)
- Yafeng Pan
- Department of Psychology and Behavioral SciencesZhejiang UniversityHangzhou310058China
- Department of Clinical NeuroscienceKarolinska InstitutetStockholm17165Sweden
| | - Mikkel C. Vinding
- Department of Clinical NeuroscienceKarolinska InstitutetStockholm17165Sweden
- Danish Research Centre for Magnetic Resonance, Centre for Functional and Diagnostic Imaging and ResearchCopenhagen University Hospital ‐ Amager and HvidovreCopenhagen2650Denmark
| | - Lei Zhang
- Centre for Human Brain HealthSchool of PsychologyUniversity of BirminghamBirminghamB15 2TTUK
- Institute for Mental HealthSchool of PsychologyUniversity of BirminghamBirminghamB15 2TTUK
- SocialCognitive and Affective Neuroscience UnitDepartment of CognitionEmotionand Methods in PsychologyFaculty of PsychologyUniversity of ViennaVienna1010Austria
| | - Daniel Lundqvist
- Department of Clinical NeuroscienceKarolinska InstitutetStockholm17165Sweden
| | - Andreas Olsson
- Department of Clinical NeuroscienceKarolinska InstitutetStockholm17165Sweden
| |
Collapse
|
5
|
Björlin Avdic H, Strannegård C, Engberg H, Willfors C, Nordgren I, Frisén L, Hirschberg AL, Guath M, Nordgren A, Kleberg JL. Reduced effects of social feedback on learning in Turner syndrome. Sci Rep 2023; 13:15858. [PMID: 37739980 PMCID: PMC10516979 DOI: 10.1038/s41598-023-42628-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 09/12/2023] [Indexed: 09/24/2023] Open
Abstract
Turner syndrome is a genetic condition caused by a complete or partial loss of one of the X chromosomes. Previous studies indicate that Turner syndrome is associated with challenges in social skills, but the underlying mechanisms remain largely unexplored. A possible mechanism is a reduced social influence on learning. The current study examined the impact of social and non-social feedback on learning in women with Turner syndrome (n = 35) and a sex- and age-matched control group (n = 37). Participants were instructed to earn points by repeatedly choosing between two stimuli with unequal probabilities of resulting in a reward. Mastering the task therefore required participants to learn through feedback which of the two stimuli was more likely to be rewarded. Data were analyzed using computational modeling and analyses of choice behavior. Social feedback led to a more explorative choice behavior in the control group, resulting in reduced learning compared to non-social feedback. No effects of social feedback on learning were found in Turner syndrome. The current study thus indicates that women with Turner syndrome may be less sensitive to social influences on reinforcement learning, than the general population.
Collapse
Affiliation(s)
- Hanna Björlin Avdic
- Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet & Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden.
| | - Claes Strannegård
- Department of Molecular Medicine and Surgery, Center for Molecular Medicine, Karolinska Institutet, Stockholm, Sweden
- Division of Cognition and Communication, Department of Applied IT, University of Gothenburg, Gothenburg, Sweden
| | - Hedvig Engberg
- Department of Women's and Children's Health, Karolinska Institutet & Department of Gynaecology and Reproductive Medicine, Karolinska University Hospital, Stockholm, Sweden
| | - Charlotte Willfors
- Department of Molecular Medicine and Surgery, Center for Molecular Medicine, Karolinska Institutet, Stockholm, Sweden
| | - Ida Nordgren
- Department of Molecular Medicine and Surgery, Center for Molecular Medicine, Karolinska Institutet, Stockholm, Sweden
| | - Louise Frisén
- Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet & Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden
| | - Angelica Lindén Hirschberg
- Department of Women's and Children's Health, Karolinska Institutet & Department of Gynaecology and Reproductive Medicine, Karolinska University Hospital, Stockholm, Sweden
| | - Mona Guath
- Department of Psychology, Uppsala University, Uppsala, Sweden
| | - Ann Nordgren
- Department of Molecular Medicine and Surgery, Center for Molecular Medicine, Karolinska Institutet, Stockholm, Sweden
- Department of Laboratory Medicine, Institute of Biomedicine, University of Gothenburg, Gothenburg, Sweden
- Department of Clinical Genetics and Genomics, Sahlgrenska University Hospital, Gothenburg, Sweden
- Department of Clinical Genetics, Karolinska University Hospital, Stockholm, Sweden
| | - Johan Lundin Kleberg
- Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet & Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden
- Department of Psychology, Stockholm University, Stockholm, Sweden
| |
Collapse
|
6
|
Dinckol O, Zachry JE, Kutlu MG. Nucleus accumbens core single cell ensembles bidirectionally respond to experienced versus observed aversive events. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.07.17.549364. [PMID: 37503203 PMCID: PMC10370069 DOI: 10.1101/2023.07.17.549364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/29/2023]
Abstract
Empathy is the ability to adopt others' sensory and emotional states and is an evolutionarily conserved trait among mammals. In rodents, empathy manifests itself as social modulation of aversive stimuli such as acknowledging and acting on conspecifics' distress. The neuronal network underlying social transmission of information is known to overlap with the brain regions that mediate behavioral responses to aversive and rewarding stimuli. In this study, we recorded single cell activity patterns of nucleus accumbens (NAc) core neurons using in vivo optical imaging of calcium transients via miniature scopes. This cutting-edge imaging methodology not only allows us to record activity patterns of individual neurons but also lets us longitudinally follow these individual neurons across time and different behavioral states. Using this approach, we identified NAc core single cell ensembles that respond to experienced and/or observed aversive stimuli. Our results showed that experienced and observed aversive stimuli evoke NAc core ensemble activity that is largely positive, with a smaller subset of negative responses. The size of the NAc single cell ensemble response was greater for experienced aversive stimuli compared to observed aversive events. Our results also revealed a subpopulation within the NAc core single cell ensembles that show a bidirectional response to experienced aversive stimuli versus observed aversive stimuli (i.e., negative response to experienced and positive response to observed). These results suggest that the NAc plays a role in differentiating somatosensory experience from social observation of aversion at a single cell level. This has important implications for psychopathologies where social information processing is maladaptive, such as autism spectrum disorders.
Collapse
Affiliation(s)
| | | | - Munir Gunes Kutlu
- Department of Cell Biology and Neuroscience, Rowan-Virtua School of Osteopathic Medicine, Stratford, NJ, USA
- Graduate School of Biomedical Sciences, Rowan-Virtua School of Osteopathic Medicine, Stratford, NJ, USA
| |
Collapse
|