1
|
A cognitive-computational account of mood swings in adolescence. Trends Cogn Sci 2024; 28:290-303. [PMID: 38503636 DOI: 10.1016/j.tics.2024.02.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 02/06/2024] [Accepted: 02/12/2024] [Indexed: 03/21/2024]
Abstract
Teenagers have a reputation for being fickle, in both their choices and their moods. This variability may help adolescents as they begin to independently navigate novel environments. Recently, however, adolescent moodiness has also been linked to psychopathology. Here, we consider adolescents' mood swings from a novel computational perspective, grounded in reinforcement learning (RL). This model proposes that mood is determined by surprises about outcomes in the environment, and how much we learn from these surprises. It additionally suggests that mood biases learning and choice in a bidirectional manner. Integrating independent lines of research, we sketch a cognitive-computational account of how adolescents' mood, learning, and choice dynamics influence each other, with implications for normative and psychopathological development.
Collapse
|
2
|
Self-reported childhood family adversity is linked to an attenuated gain of trust during adolescence. Nat Commun 2023; 14:6920. [PMID: 37903767 PMCID: PMC10616102 DOI: 10.1038/s41467-023-41531-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Accepted: 09/07/2023] [Indexed: 11/01/2023] Open
Abstract
A longstanding proposal in developmental research is that childhood family experiences provide a template that shapes a capacity for trust-based social relationships. We leveraged longitudinal data from a cohort of healthy adolescents (n = 570, aged 14-25), which included decision-making and psychometric data, to characterise normative developmental trajectories of trust behaviour and inter-individual differences therein. Extending on previous cross-sectional findings from the same cohort, we show that a task-based measure of trust increases longitudinally from adolescence into young adulthood. Computational modelling suggests this is due to a decrease in social risk aversion. Self-reported family adversity attenuates this developmental gain in trust behaviour, and within our computational model, this relates to a higher 'irritability' parameter in those reporting greater adversity. Unconditional trust at measurement time point T1 predicts the longitudinal trajectory of self-reported peer relation quality, particularly so for those with higher family adversity, consistent with trust acting as a resilience factor.
Collapse
|
3
|
Universal prevention for non-suicidal self-injury in adolescents is scarce - A systematic review. Front Psychiatry 2023; 14:1130610. [PMID: 37937233 PMCID: PMC10627158 DOI: 10.3389/fpsyt.2023.1130610] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Accepted: 10/02/2023] [Indexed: 11/09/2023] Open
Abstract
Non-suicidal self-injury (NSSI) during adolescence is a high-risk marker for the development and persistence of mental health problems and has been recognized as a significant public health problem. Whereas targeted prevention has indeed shown to be effective in reducing NSSI and improve mental health problems, access to such programs is limited. By face validity, universal prevention of NSSI seems an ideal starting point for a stepped-care model to circumvent a lack of resources in the medical care system. However, it is yet unclear how effective such approaches are. Here, we provide a summary of existing work on universal prevention of NSSI in adolescents younger than 21 years based on a systematic literature search. We found that only seven studies are available. None of the programs evaluated was found to be effective in reducing the incidence or frequency of NSSI. After providing a comprehensive summary of the existing work, we evaluate the fact that existing work primarily focusses on selected/targeted prevention and on psychoeducational methods. We derive implications for future directions in the field of universal prevention of NSSI.
Collapse
|
4
|
Fear conditioning and fear generalization in children and adolescents with anxiety disorders. Eur Child Adolesc Psychiatry 2023:10.1007/s00787-023-02304-7. [PMID: 37794273 DOI: 10.1007/s00787-023-02304-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Accepted: 09/10/2023] [Indexed: 10/06/2023]
Abstract
Overgeneralization of conditioned fear is associated with anxiety disorders (AD). Most results stem from studies done in adult patients, but studies with children are rare, although the median onset of anxiety disorders lies already in childhood. Thus, the goal of the present study was to examine fear learning and generalization in youth participants, aged 10-17 years, with AD (n = 39) compared to healthy controls (HC) (n = 40). A discriminative fear conditioning and generalization paradigm was used. Ratings of arousal, valence, and US expectancy (the probability of an aversive noise following each stimulus) were measured, hypothesizing that children with AD compared to HC would show heightened ratings of arousal and US expectancy, and decreased positive valence ratings, respectively, as well as overgeneralization of fear. The results indicated that children with AD rated all stimuli as more arousing and less pleasant, and demonstrated higher US expectancy ratings to all stimuli when compared to HC. Thus, rather than displaying qualitatively different generalization patterns (e.g., a linear vs. quadratic slope of the gradient), differences between groups were more quantitative (similar, but parallel shifted gradient). Therefore, overgeneralization of conditioned fear does not seem to be a general marker of anxiety disorders in children and adolescents.
Collapse
|
5
|
Publisher Correction: Investigating adult age differences in real-life empathy, prosociality, and well-being using experience sampling. Sci Rep 2023; 13:13777. [PMID: 37612407 PMCID: PMC10447415 DOI: 10.1038/s41598-023-40699-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/25/2023] Open
|
6
|
Diminished reinforcement sensitivity in adolescence is associated with enhanced response switching and reduced coding of choice probability in the medial frontal pole. Dev Cogn Neurosci 2023; 60:101226. [PMID: 36905874 PMCID: PMC10005907 DOI: 10.1016/j.dcn.2023.101226] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Revised: 03/06/2023] [Accepted: 03/06/2023] [Indexed: 03/09/2023] Open
Abstract
Precisely charting the maturation of core neurocognitive functions such as reinforcement learning (RL) and flexible adaptation to changing action-outcome contingencies is key for developmental neuroscience and adjacent fields like developmental psychiatry. However, research in this area is both sparse and conflicted, especially regarding potentially asymmetric development of learning for different motives (obtain wins vs avoid losses) and learning from valenced feedback (positive vs negative). In the current study, we investigated the development of RL from adolescence to adulthood, using a probabilistic reversal learning task modified to experimentally separate motivational context and feedback valence, in a sample of 95 healthy participants between 12 and 45. We show that adolescence is characterized by enhanced novelty seeking and response shifting especially after negative feedback, which leads to poorer returns when reward contingencies are stable. Computationally, this is accounted for by reduced impact of positive feedback on behavior. We also show, using fMRI, that activity of the medial frontopolar cortex reflecting choice probability is attenuated in adolescence. We argue that this can be interpreted as reflecting diminished confidence in upcoming choices. Interestingly, we find no age-related differences between learning in win and loss contexts.
Collapse
|
7
|
Revealing human sensitivity to a latent temporal structure of changes. Front Behav Neurosci 2022; 16:962494. [PMID: 36325156 PMCID: PMC9621332 DOI: 10.3389/fnbeh.2022.962494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Accepted: 09/26/2022] [Indexed: 11/29/2022] Open
Abstract
Precisely timed behavior and accurate time perception plays a critical role in our everyday lives, as our wellbeing and even survival can depend on well-timed decisions. Although the temporal structure of the world around us is essential for human decision making, we know surprisingly little about how representation of temporal structure of our everyday environment impacts decision making. How does the representation of temporal structure affect our ability to generate well-timed decisions? Here we address this question by using a well-established dynamic probabilistic learning task. Using computational modeling, we found that human subjects' beliefs about temporal structure are reflected in their choices to either exploit their current knowledge or to explore novel options. The model-based analysis illustrates a large within-group and within-subject heterogeneity. To explain these results, we propose a normative model for how temporal structure is used in decision making, based on the semi-Markov formalism in the active inference framework. We discuss potential key applications of the presented approach to the fields of cognitive phenotyping and computational psychiatry.
Collapse
|
8
|
Investigating adult age differences in real-life empathy, prosociality, and well-being using experience sampling. Sci Rep 2022; 12:3450. [PMID: 35236872 PMCID: PMC8891267 DOI: 10.1038/s41598-022-06620-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Accepted: 02/02/2022] [Indexed: 12/11/2022] Open
Abstract
While the importance of social affect and cognition is indisputable throughout the adult lifespan, findings of how empathy and prosociality develop and interact across adulthood are mixed and real-life data are scarce. Research using ecological momentary assessment recently demonstrated that adults commonly experience empathy in daily life. Furthermore, experiencing empathy was linked to higher prosocial behavior and subjective well-being. However, to date, it is not clear whether there are adult age differences in daily empathy and daily prosociality and whether age moderates the relationship between empathy and prosociality across adulthood. Here we analyzed experience-sampling data collected from participants across the adult lifespan to study age effects on empathy, prosocial behavior, and well-being under real-life circumstances. Linear and quadratic age effects were found for the experience of empathy, with increased empathy across the three younger age groups (18 to 45 years) and a slight decrease in the oldest group (55 years and older). Neither prosocial behavior nor well-being showed significant age-related differences. We discuss these findings with respect to (partially discrepant) results derived from lab-based and traditional survey studies. We conclude that studies linking in-lab experiments with real-life experience-sampling may be a promising venue for future lifespan studies.
Collapse
|
9
|
More by stick than by carrot: A reinforcement learning style rooted in the medial frontal cortex in anorexia nervosa. JOURNAL OF ABNORMAL PSYCHOLOGY 2021; 130:736-747. [PMID: 34780229 DOI: 10.1037/abn0000690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Anorexia nervosa (AN) is characterized by a relentless pursuit of thinness, despite serious implications for health and social relations. In a previous study wielding the power of computational psychiatry, we found alterations in learning from negative feedback and in neural activity in the posterior medial frontal cortex (pMFC) in young acutely underweight AN patients (acAN). Here we ask whether these abnormalities are merely a state-related consequence of the illness or whether they might constitute a trait marker predisposing individuals to AN. To address this question, we employed the same reinforcement learning paradigm during fMRI with 31 female former AN patients after complete weight-recovery (recAN) and 31 age-matched healthy volunteers (15-28 years). Participants performed a decision task that required adaptation to changing reward contingencies. Data were analyzed within a hierarchical Gaussian filter model, which captures interindividual variability in feedback learning and decision-making under uncertainty. Similar to acute patients, individuals recovered from AN appear to emphasize negative over positive feedback when updating expectations regarding changing reward-punishment contingencies (difference in learning rate between punished and rewarded trials was increased in recAN: p = .006, d = .70. This behavioral pattern was mirrored in hyperactivation of the pMFC following negative feedback (FWE p < .001). Because the previously observed alterations in acANs are also evident after recovery and do not correlate with state variables like weight, altered feedback learning might be a trait marker of AN. The neural underpinnings of these alterations may lie in the pMFC. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
|
10
|
The ageing of the social mind: replicating the preservation of socio-affective and the decline of socio-cognitive processes in old age. ROYAL SOCIETY OPEN SCIENCE 2021; 8:210641. [PMID: 34457343 PMCID: PMC8386516 DOI: 10.1098/rsos.210641] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/17/2020] [Accepted: 08/04/2021] [Indexed: 05/06/2023]
Abstract
Anticipating population ageing to reach a historically unprecedented level in this century and considering the public goal of promoting well-being until old age, research in many fields has started to focus on processes and factors that contribute to healthy ageing. Since human interactions have a tremendous impact on our mental and physical well-being, scientists are increasingly investigating the basic processes that enable successful social interactions such as social affect (empathy, compassion) and social cognition (Theory of Mind). However, regarding the replication crisis in psychological science it is crucial to probe the reproducibility of findings revealed by each specific method. To this end, we aimed to replicate the effect of age on empathy, compassion and Theory of Mind observed in Reiter and colleagues' study (Reiter et al. 2017 Sci. Rep. 7, 11046 (doi:10.1038/s41598-017-10669-4)) by using the same ecologically valid paradigm in an independent sample with similar age ranges. We were able to replicate the previously observed results of a preservation or even enhancement in socio-affective processes, but a decline in socio-cognitive processes for older adults. Our findings add to the understanding of how social affect and cognition change across the adult lifespan and may suggest targets for intervention studies aiming to foster successful social interactions and well-being until advanced old age.
Collapse
|
11
|
Anger regulation choice-The role of age and habitual reappraisal. ACTA ACUST UNITED AC 2021; 22:1639-1652. [PMID: 34138583 DOI: 10.1037/emo0000915] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The ability to choose emotion regulation strategies in accordance to contextual demands, known as emotion regulation flexibility, is key to healthy adaptation. While recent investigations on spontaneous emotion regulation choice tested the effects of emotional intensity and age using standardized negative pictures with no particular emotional quality, we elicited the discrete emotion of anger with personally relevant autobiographical memories in a sample of 52 younger and 41 older adults. In addition, we included habitual reappraisal as a predictor of emotion regulation choice. Our main hypothesis was that, compared with younger adults, older adults prefer less resource-demanding emotion regulation strategies (i.e., distraction) over more resource-demanding strategies (i.e., reappraisal), particularly if older adults' habitual reappraisal is low and the to-be-regulated anger is of high intensity. Surprisingly, our findings suggest that only older adults' emotion regulation choices depend on the emotional intensity of the autobiographical memory and habitual reappraisal. Only older adults with high habitual reappraisal preferred to reappraise their anger in situations of low anger intensity but switched to the less demanding strategy of distraction in high anger memories, indicating emotion regulation flexibility. This study extends previous research by testing emotion regulation choices in natural contexts and considering regulation habits. Although we replicate previous findings of emotion regulation flexibility according to emotional intensity in anger memories for older adults with high habitual reappraisal only, our findings illustrate the relevance of reappraisal habits to emotion regulation choice in age-comparative research. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
|
12
|
Human aging alters social inference about others' changing intentions. Neurobiol Aging 2021; 103:98-108. [PMID: 33845400 DOI: 10.1016/j.neurobiolaging.2021.01.034] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2020] [Revised: 01/08/2021] [Accepted: 01/09/2021] [Indexed: 01/28/2023]
Abstract
Decoding others' intentions accurately in order to adapt one's own behavior is pivotal throughout life. In this study, we asked how younger and older adults deal with uncertainty in dynamic social environments. We used an advice-taking paradigm together with Bayesian modeling to characterize effects of aging on learning about others' time-varying intentions. We observed age differences when comparing learning on two levels of social uncertainty: the fidelity of the adviser and the volatility of intentions. Older adults expected the adviser to change his/her intentions more frequently (i.e., a higher volatility of the adviser). They also showed higher confidence (i.e., precision) in their volatility beliefs and were less willing to change their beliefs about volatility over the course of the experiment. This led them to update their predictions about the fidelity of the adviser more quickly. Potentially indicative of stereotype effects, we observed that older advisers were perceived as more volatile, but also more faithful than younger advisers. This offers new insights into adult age differences in response to social uncertainty.
Collapse
|
13
|
Positivity in Younger and in Older Age: Associations With Future Time Perspective and Socioemotional Functioning. Front Psychol 2020; 11:567133. [PMID: 33281667 PMCID: PMC7705101 DOI: 10.3389/fpsyg.2020.567133] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Accepted: 10/22/2020] [Indexed: 12/05/2022] Open
Abstract
Aging has been associated with a motivational shift to positive over negative information (i.e., positivity effect), which is often explained by a limited future time perspective (FTP) within the framework of socioemotional selectivity theory (SST). However, whether a limited FTP functions similarly in younger and older adults, and whether inter-individual differences in socioemotional functioning are similarly associated with preference for positive information (i.e., positivity) is still not clear. We investigated younger (20–35 years, N = 73) and older (60–75 years, N = 56) adults’ gaze preferences on pairs of happy, angry, sad, and neutral faces using an eye-tracking system. We additionally assessed several parameters potentially underlying inter-individual differences in emotion processing such as FTP, stress, cognitive functioning, social support, emotion regulation, and well-being. While we found no age-related differences in positivity when the entire trial duration was considered, older adults showed longer fixations on the more positive face in later stages of processing (i.e., positivity shifts). This allocation of resources toward more positive stimuli might serve an emotion regulatory purpose and seems consistent with the SST. However, our findings suggest that age moderates the relationship between FTP and positivity shifts, such that the relationship between FTP and positivity preferences was negative in older, and positive in younger adults, potentially stemming from an age-related differential meaning of the FTP construct across age. Furthermore, our exploratory analyses showed that along with the age and FTP interaction, lower levels of worry also played a significant role in positivity shifts. We conclude that positivity effects cannot be solely explained by aging, or the associated reduced FTP per se, but is rather determined by a complex interplay of psychosocial and emotional features.
Collapse
|
14
|
A mind-brain-body dataset of MRI, EEG, cognition, emotion, and peripheral physiology in young and old adults. Sci Data 2019; 6:180308. [PMID: 30747911 PMCID: PMC6371893 DOI: 10.1038/sdata.2018.308] [Citation(s) in RCA: 117] [Impact Index Per Article: 23.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2018] [Accepted: 10/12/2018] [Indexed: 12/14/2022] Open
Abstract
We present a publicly available dataset of 227 healthy participants comprising a young (N=153, 25.1±3.1 years, range 20-35 years, 45 female) and an elderly group (N=74, 67.6±4.7 years, range 59-77 years, 37 female) acquired cross-sectionally in Leipzig, Germany, between 2013 and 2015 to study mind-body-emotion interactions. During a two-day assessment, participants completed MRI at 3 Tesla (resting-state fMRI, quantitative T1 (MP2RAGE), T2-weighted, FLAIR, SWI/QSM, DWI) and a 62-channel EEG experiment at rest. During task-free resting-state fMRI, cardiovascular measures (blood pressure, heart rate, pulse, respiration) were continuously acquired. Anthropometrics, blood samples, and urine drug tests were obtained. Psychiatric symptoms were identified with Standardized Clinical Interview for DSM IV (SCID-I), Hamilton Depression Scale, and Borderline Symptoms List. Psychological assessment comprised 6 cognitive tests as well as 21 questionnaires related to emotional behavior, personality traits and tendencies, eating behavior, and addictive behavior. We provide information on study design, methods, and details of the data. This dataset is part of the larger MPI Leipzig Mind-Brain-Body database.
Collapse
|
15
|
Association of peripheral blood pressure with gray matter volume in 19- to 40-year-old adults. Neurology 2019; 92:e758-e773. [PMID: 30674602 DOI: 10.1212/wnl.0000000000006947] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2018] [Accepted: 10/15/2018] [Indexed: 12/26/2022] Open
Abstract
OBJECTIVE To test whether elevated blood pressure (BP) relates to gray matter (GM) volume (GMV) changes in young adults who had not previously been diagnosed with hypertension (systolic BP [SBP]/diastolic BP [DBP] ≥140/90 mm Hg). METHODS We associated BP with GMV from structural 3T T1-weighted MRI of 423 healthy adults between 19 and 40 years of age (mean age 27.7 ± 5.3 years, 177 women, SBP/DBP 123.2/73.4 ± 12.2/8.5 mm Hg). Data originated from 4 previously unpublished cross-sectional studies conducted in Leipzig, Germany. We performed voxel-based morphometry on each study separately and combined results in image-based meta-analyses (IBMA) to assess cumulative effects across studies. Resting BP was assigned to 1 of 4 categories: (1) SBP <120 and DBP <80 mm Hg, (2) SBP 120-129 or DBP 80-84 mm Hg, (3) SBP 130-139 or DBP 85-89 mm Hg, (4) SBP ≥140 or DBP ≥90 mm Hg. RESULTS IBMA yielded the following results: (1) lower regional GMV was correlated with higher peripheral BP; (2) lower GMV was found with higher BP when comparing individuals in subhypertensive categories 3 and 2, respectively, to those in category 1; (3) lower BP-related GMV was found in regions including hippocampus, amygdala, thalamus, frontal, and parietal structures (e.g., precuneus). CONCLUSION BP ≥120/80 mm Hg was associated with lower GMV in regions that have previously been related to GM decline in older individuals with manifest hypertension. Our study shows that BP-associated GM alterations emerge continuously across the range of BP and earlier in adulthood than previously assumed. This suggests that treating hypertension or maintaining lower BP in early adulthood might be essential for preventing the pathophysiologic cascade of asymptomatic cerebrovascular disease to symptomatic end-organ damage, such as stroke or dementia.
Collapse
|
16
|
Risk contagion by peers affects learning and decision-making in adolescents. J Exp Psychol Gen 2019; 148:1494-1504. [PMID: 30667261 DOI: 10.1037/xge0000512] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Adolescence is a period of life in which social influences-particularly if they come from peers-play a critical role in shaping learning and decision preferences. Recent studies in adults show evidence of a risk contagion effect; that is, individual risk preferences are modulated by observing and learning from others' risk-related decisions. In this study, using choice data and computational modeling, we demonstrate stronger risk contagion in male adolescents when observing peers compared to nonpeers. This effect was only present when the observed peer showed risk-seeking preferences. Moreover, adolescents represented the peers' decisions better than those of adults. Intriguingly, the degree of peer-biased risk contagion in adolescents was positively associated with real-life social integration. Contrary to previous accounts, our data suggest that peer conformity during risky decision-making in adolescence is a socially motivated, deliberative process. Susceptibility to peer influence in adolescence might be adaptive, associated with higher degrees of social functioning. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Collapse
|
17
|
Predicting change: Approximate inference under explicit representation of temporal structure in changing environments. PLoS Comput Biol 2019; 15:e1006707. [PMID: 30703108 PMCID: PMC6372216 DOI: 10.1371/journal.pcbi.1006707] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2018] [Revised: 02/12/2019] [Accepted: 12/11/2018] [Indexed: 11/18/2022] Open
Abstract
In our daily lives timing of our actions plays an essential role when we navigate the complex everyday environment. It is an open question though how the representations of the temporal structure of the world influence our behavior. Here we propose a probabilistic model with an explicit representation of state durations which may provide novel insights in how the brain predicts upcoming changes. We illustrate several properties of the behavioral model using a standard reversal learning design and compare its task performance to standard reinforcement learning models. Furthermore, using experimental data, we demonstrate how the model can be applied to identify participants' beliefs about the latent temporal task structure. We found that roughly one quarter of participants seem to have learned the latent temporal structure and used it to anticipate changes, whereas the remaining participants' behavior did not show signs of anticipatory responses, suggesting a lack of precise temporal expectations. We expect that the introduced behavioral model will allow, in future studies, for a systematic investigation of how participants learn the underlying temporal structure of task environments and how these representations shape behavior.
Collapse
|
18
|
Altered Medial Frontal Feedback Learning Signals in Anorexia Nervosa. Biol Psychiatry 2018; 83:235-243. [PMID: 29025688 DOI: 10.1016/j.biopsych.2017.07.024] [Citation(s) in RCA: 39] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/10/2017] [Revised: 06/12/2017] [Accepted: 07/05/2017] [Indexed: 12/11/2022]
Abstract
BACKGROUND In their relentless pursuit of thinness, individuals with anorexia nervosa (AN) engage in maladaptive behaviors (restrictive food choices and overexercising) that may originate in altered decision making and learning. METHODS In this functional magnetic resonance imaging study, we employed computational modeling to elucidate the neural correlates of feedback learning and value-based decision making in 36 female patients with AN and 36 age-matched healthy volunteers (12-24 years). Participants performed a decision task that required adaptation to changing reward contingencies. Data were analyzed within a hierarchical Gaussian filter model that captures interindividual variability in learning under uncertainty. RESULTS Behaviorally, patients displayed an increased learning rate specifically after punishments. At the neural level, hemodynamic correlates for the learning rate, expected value, and prediction error did not differ between the groups. However, activity in the posterior medial frontal cortex was elevated in AN following punishment. CONCLUSIONS Our findings suggest that the neural underpinning of feedback learning is selectively altered for punishment in AN.
Collapse
|
19
|
Developmental Changes in Learning: Computational Mechanisms and Social Influences. Front Psychol 2017; 8:2048. [PMID: 29250006 PMCID: PMC5715389 DOI: 10.3389/fpsyg.2017.02048] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2017] [Accepted: 11/09/2017] [Indexed: 11/13/2022] Open
Abstract
Our ability to learn from the outcomes of our actions and to adapt our decisions accordingly changes over the course of the human lifespan. In recent years, there has been an increasing interest in using computational models to understand developmental changes in learning and decision-making. Moreover, extensions of these models are currently applied to study socio-emotional influences on learning in different age groups, a topic that is of great relevance for applications in education and health psychology. In this article, we aim to provide an introduction to basic ideas underlying computational models of reinforcement learning and focus on parameters and model variants that might be of interest to developmental scientists. We then highlight recent attempts to use reinforcement learning models to study the influence of social information on learning across development. The aim of this review is to illustrate how computational models can be applied in developmental science, what they can add to our understanding of developmental mechanisms and how they can be used to bridge the gap between psychological and neurobiological theories of development.
Collapse
|
20
|
Impaired Flexible Reward-Based Decision-Making in Binge Eating Disorder: Evidence from Computational Modeling and Functional Neuroimaging. Neuropsychopharmacology 2017; 42:628-637. [PMID: 27301429 PMCID: PMC5240187 DOI: 10.1038/npp.2016.95] [Citation(s) in RCA: 67] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/29/2015] [Revised: 05/11/2016] [Accepted: 05/24/2016] [Indexed: 12/17/2022]
Abstract
Despite its clinical relevance and the recent recognition as a diagnostic category in the DSM-5, binge eating disorder (BED) has rarely been investigated from a cognitive neuroscientific perspective targeting a more precise neurocognitive profiling of the disorder. BED patients suffer from a lack of behavioral control during recurrent binge eating episodes and thus fail to adapt their behavior in the face of negative consequences, eg, high risk for obesity. To examine impairments in flexible reward-based decision-making, we exposed BED patients (n=22) and matched healthy individuals (n=22) to a reward-guided decision-making task during functional resonance imaging (fMRI). Performing fMRI analysis informed via computational modeling of choice behavior, we were able to identify specific signatures of altered decision-making in BED. On the behavioral level, we observed impaired behavioral adaptation in BED, which was due to enhanced switching behavior, a putative deficit in striking a balance between exploration and exploitation appropriately. This was accompanied by diminished activation related to exploratory decisions in the anterior insula/ventro-lateral prefrontal cortex. Moreover, although so-called model-free reward prediction errors remained intact, representation of ventro-medial prefrontal learning signatures, incorporating inference on unchosen options, was reduced in BED, which was associated with successful decision-making in the task. On the basis of a computational psychiatry account, the presented findings contribute to defining a neurocognitive phenotype of BED.
Collapse
|
21
|
The Feedback-related Negativity Codes Components of Abstract Inference during Reward-based Decision-making. J Cogn Neurosci 2016; 28:1127-38. [DOI: 10.1162/jocn_a_00957] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
Abstract
Behavioral control is influenced not only by learning from the choices made and the rewards obtained but also by “what might have happened,” that is, inference about unchosen options and their fictive outcomes. Substantial progress has been made in understanding the neural signatures of direct learning from choices that are actually made and their associated rewards via reward prediction errors (RPEs). However, electrophysiological correlates of abstract inference in decision-making are less clear. One seminal theory suggests that the so-called feedback-related negativity (FRN), an ERP peaking 200–300 msec after a feedback stimulus at frontocentral sites of the scalp, codes RPEs. Hitherto, the FRN has been predominantly related to a so-called “model-free” RPE: The difference between the observed outcome and what had been expected. Here, by means of computational modeling of choice behavior, we show that individuals employ abstract, “double-update” inference on the task structure by concurrently tracking values of chosen stimuli (associated with observed outcomes) and unchosen stimuli (linked to fictive outcomes). In a parametric analysis, model-free RPEs as well as their modification because of abstract inference were regressed against single-trial FRN amplitudes. We demonstrate that components related to abstract inference uniquely explain variance in the FRN beyond model-free RPEs. These findings advance our understanding of the FRN and its role in behavioral adaptation. This might further the investigation of disturbed abstract inference, as proposed, for example, for psychiatric disorders, and its underlying neural correlates.
Collapse
|
22
|
Risk Factors for Addiction and Their Association with Model-Based Behavioral Control. Front Behav Neurosci 2016; 10:26. [PMID: 27013998 PMCID: PMC4794491 DOI: 10.3389/fnbeh.2016.00026] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2015] [Accepted: 02/04/2016] [Indexed: 01/17/2023] Open
Abstract
Addiction shows familial aggregation and previous endophenotype research suggests that healthy relatives of addicted individuals share altered behavioral and cognitive characteristics with individuals suffering from addiction. In this study we asked whether impairments in behavioral control proposed for addiction, namely a shift from goal-directed, model-based toward habitual, model-free control, extends toward an unaffected sample (n = 20) of adult children of alcohol-dependent fathers as compared to a sample without any personal or family history of alcohol addiction (n = 17). Using a sequential decision-making task designed to investigate model-free and model-based control combined with a computational modeling analysis, we did not find any evidence for altered behavioral control in individuals with a positive family history of alcohol addiction. Independent of family history of alcohol dependence, we however observed that the interaction of two different risk factors of addiction, namely impulsivity and cognitive capacities, predicts the balance of model-free and model-based behavioral control. Post-hoc tests showed a positive association of model-based behavior with cognitive capacity in the lower, but not in the higher impulsive group of the original sample. In an independent sample of particularly high- vs. low-impulsive individuals, we confirmed the interaction effect of cognitive capacities and high vs. low impulsivity on model-based control. In the confirmation sample, a positive association of omega with cognitive capacity was observed in highly impulsive individuals, but not in low impulsive individuals. Due to the moderate sample size of the study, further investigation of the association of risk factors for addiction with model-based behavior in larger sample sizes is warranted.
Collapse
|
23
|
The interaction of acute and chronic stress impairs model-based behavioral control. Psychoneuroendocrinology 2015; 53:268-80. [PMID: 25662093 DOI: 10.1016/j.psyneuen.2014.12.017] [Citation(s) in RCA: 80] [Impact Index Per Article: 8.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/12/2014] [Revised: 11/14/2014] [Accepted: 12/02/2014] [Indexed: 11/26/2022]
Abstract
It is suggested that acute stress shifts behavioral control from goal-directed, model-based toward habitual, model-free strategies. Recent findings indicate that interindividual differences in the cortisol stress response influence model-based decision-making. Although not yet investigated in humans, animal studies show that chronic stress also shifts decision-making toward more habitual behavior. Here, we ask whether acute stress and individual vulnerability factors, such as stress reactivity and previous exposure to stressful life events, impact the balance between model-free and model-based control systems. To test this, 39 male participants (21-30 years old) were exposed to a potent psychosocial stressor (Trier Social Stress Test) and a control condition in a within-subjects design before they performed a sequential decision-making task which evaluates the balance between the two systems. Physiological and subjective stress reactivity was assessed before, during, and after acute stress exposure. By means of computational modeling, we demonstrate that interindividual variability in stress reactivity predicts impairments in model-based decision-making. Whereas acute psychosocial stress did not alter model-based behavioral control, we found chronic and acute stress to interact in their detrimental effect on decision-making: subjects with high but not low chronic stress levels as indicated by stressful life events exhibited reduced model-based control in response to acute psychosocial stress. These findings emphasize that stress reactivity and chronic stress play an important role in mediating the relationship between stress and decision-making. Our results might stimulate new insights into the interplay between chronic and acute stress, attenuated model-based control, and the pathogenesis of various psychiatric diseases.
Collapse
|
24
|
|