A social inference model of idealization and devaluation

People often form polarized beliefs, imbuing objects (e.g., themselves or others) with unambiguously positive or negative qualities. In clinical settings, this is referred to as dichotomous thinking or "splitting" and is a feature of several psychiatric disorders. Here, we introduce a Bayesian model of splitting that parameterizes a tendency to rigidly categorize objects as either entirely "Bad" or "Good," rather than to flexibly learn dispositions along a continuous scale. Distinct from the previous descriptive theories, the model makes quantitative predictions about how dichotomous beliefs emerge and are updated in light of new information. Specifically, the model addresses how splitting is context-dependent, yet exhibits stability across time. A key model feature is that phases of devaluation and/or idealization are consolidated by rationally attributing counter-evidence to external factors. For example, when another person is idealized, their less-than-perfect behavior is attributed to unfavorable external circumstances. However, sufficient counter-evidence can trigger switches of polarity, producing bistable dynamics. We show that the model can be fitted to empirical data, to measure individual susceptibility to relational instability. For example, we find that a latent categorical belief that others are "Good" accounts for less changeable, and more certain, character impressions of benevolent as opposed to malevolent others among healthy participants. By comparison, character impressions made by participants with borderline personality disorder reveal significantly higher and more symmetric splitting. The generative framework proposed invites applications for modeling oscillatory relational and affective dynamics in psychotherapeutic contexts. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Parallel cognitive maps for multiple knowledge structures in the hippocampal formation

The hippocampal-entorhinal system uses cognitive maps to represent spatial knowledge and other types of relational information. However, objects can often be characterized by different types of relations simultaneously. How does the hippocampal formation handle the embedding of stimuli in multiple relational structures that differ vastly in their mode and timescale of acquisition? Does the hippocampal formation integrate different stimulus dimensions into one conjunctive map or is each dimension represented in a parallel map? Here, we reanalyzed human functional magnetic resonance imaging data from Garvert et al. (2017) that had previously revealed a map in the hippocampal formation coding for a newly learnt transition structure. Using functional magnetic resonance imaging adaptation analysis, we found that the degree of representational similarity in the bilateral hippocampus also decreased as a function of the semantic distance between presented objects. Importantly, while both map-like structures localized to the hippocampal formation, the semantic map was located in more posterior regions of the hippocampal formation than the transition structure and thus anatomically distinct. This finding supports the idea that the hippocampal-entorhinal system forms parallel cognitive maps that reflect the embedding of objects in diverse relational structures.

Resilient functioning is associated with altered structural brain network topology in adolescents exposed to childhood adversity

Childhood adversity is one of the strongest predictors of adolescent mental illness. Therefore, it is critical that the mechanisms that aid resilient functioning in individuals exposed to childhood adversity are better understood. Here, we examined whether resilient functioning was related to structural brain network topology. We quantified resilient functioning at the individual level as psychosocial functioning adjusted for the severity of childhood adversity in a large sample of adolescents (N = 2406, aged 14-24). Next, we examined nodal degree (the number of connections that brain regions have in a network) using brain-wide cortical thickness measures in a representative subset (N = 275) using a sliding window approach. We found that higher resilient functioning was associated with lower nodal degree of multiple regions including the dorsolateral prefrontal cortex, the medial prefrontal cortex, and the posterior superior temporal sulcus (z > 1.645). During adolescence, decreases in nodal degree are thought to reflect a normative developmental process that is part of the extensive remodeling of structural brain network topology. Prior findings in this sample showed that decreased nodal degree was associated with age, as such our findings of negative associations between nodal degree and resilient functioning may therefore potentially resemble a more mature structural network configuration in individuals with higher resilient functioning.

Self-reported childhood family adversity is linked to an attenuated gain of trust during adolescence

A longstanding proposal in developmental research is that childhood family experiences provide a template that shapes a capacity for trust-based social relationships. We leveraged longitudinal data from a cohort of healthy adolescents (n = 570, aged 14-25), which included decision-making and psychometric data, to characterise normative developmental trajectories of trust behaviour and inter-individual differences therein. Extending on previous cross-sectional findings from the same cohort, we show that a task-based measure of trust increases longitudinally from adolescence into young adulthood. Computational modelling suggests this is due to a decrease in social risk aversion. Self-reported family adversity attenuates this developmental gain in trust behaviour, and within our computational model, this relates to a higher 'irritability' parameter in those reporting greater adversity. Unconditional trust at measurement time point T1 predicts the longitudinal trajectory of self-reported peer relation quality, particularly so for those with higher family adversity, consistent with trust acting as a resilience factor.

Trajectories through semantic spaces in schizophrenia and the relationship to ripple bursts

Human cognition is underpinned by structured internal representations that encode relationships between entities in the world (cognitive maps). Clinical features of schizophrenia-from thought disorder to delusions-are proposed to reflect disorganization in such conceptual representations. Schizophrenia is also linked to abnormalities in neural processes that support cognitive map representations, including hippocampal replay and high-frequency ripple oscillations. Here, we report a computational assay of semantically guided conceptual sampling and exploit this to test a hypothesis that people with schizophrenia (PScz) exhibit abnormalities in semantically guided cognition that relate to hippocampal replay and ripples. Fifty-two participants [26 PScz (13 unmedicated) and 26 age-, gender-, and intelligence quotient (IQ)-matched nonclinical controls] completed a category- and letter-verbal fluency task, followed by a magnetoencephalography (MEG) scan involving a separate sequence-learning task. We used a pretrained word embedding model of semantic similarity, coupled to a computational model of word selection, to quantify the degree to which each participant's verbal behavior was guided by semantic similarity. Using MEG, we indexed neural replay and ripple power in a post-task rest session. Across all participants, word selection was strongly influenced by semantic similarity. The strength of this influence showed sensitivity to task demands (category > letter fluency) and predicted performance. In line with our hypothesis, the influence of semantic similarity on behavior was reduced in schizophrenia relative to controls, predicted negative psychotic symptoms, and correlated with an MEG signature of hippocampal ripple power (but not replay). The findings bridge a gap between phenomenological and neurocomputational accounts of schizophrenia.

Theory-Driven Analysis of Natural Language Processing Measures of Thought Disorder Using Generative Language Modeling

BACKGROUND

Natural language processing (NLP) holds promise to transform psychiatric research and practice. A pertinent example is the success of NLP in the automatic detection of speech disorganization in formal thought disorder (FTD). However, we lack an understanding of precisely what common NLP metrics measure and how they relate to theoretical accounts of FTD. We propose tackling these questions by using deep generative language models to simulate FTD-like narratives by perturbing computational parameters instantiating theory-based mechanisms of FTD.

METHODS

We simulated FTD-like narratives using Generative-Pretrained-Transformer-2 by either increasing word selection stochasticity or limiting the model's memory span. We then examined the sensitivity of common NLP measures of derailment (semantic distance between consecutive words or sentences) and tangentiality (how quickly meaning drifts away from the topic) in detecting and dissociating the 2 underlying impairments.

RESULTS

Both parameters led to narratives characterized by greater semantic distance between consecutive sentences. Conversely, semantic distance between words was increased by increasing stochasticity, but decreased by limiting memory span. An NLP measure of tangentiality was uniquely predicted by limited memory span. The effects of limited memory span were nonmonotonic in that forgetting the global context resulted in sentences that were semantically closer to their local, intermediate context. Finally, different methods for encoding the meaning of sentences varied dramatically in performance.

CONCLUSIONS

This work validates a simulation-based approach as a valuable tool for hypothesis generation and mechanistic analysis of NLP markers in psychiatry. To facilitate dissemination of this approach, we accompany the paper with a hands-on Python tutorial.

Boosting Serotonin Increases Information Gathering by Reducing Subjective Cognitive Costs

Serotonin is implicated in the valuation of aversive costs, such as delay or physical effort. However, its role in governing sensitivity to cognitive effort, for example, deliberation costs during information gathering, is unclear. We show that treatment with a serotonergic antidepressant in healthy human individuals of either sex enhances a willingness to gather information when trying to maximize reward. Using computational modeling, we show this arises from a diminished sensitivity to subjective deliberation costs during the sampling process. This result is consistent with the notion that serotonin alleviates sensitivity to aversive costs in a domain-general fashion, with implications for its potential contribution to a positive impact on motivational deficits in psychiatric disorders.SIGNIFICANCE STATEMENT Gathering information about the world is essential for successfully navigating it. However, sampling information is costly, and we need to balance between gathering too little and too much information. The neurocomputational mechanisms underlying this arbitration between a putative gain, such as reward, and the associated costs, such as allocation of cognitive resources, remain unclear. In this study, we show that week-long daily treatment with a serotonergic antidepressant enhances a willingness to gather information when trying to maximize reward. Computational modeling indicates this arises from a reduced perception of aversive costs, rendering information gathering less cognitively effortful. This finding points to a candidate mechanism by which serotonergic treatment might help alleviate motivational deficits in a range of mental illnesses.

Spatiotemporal Precision of Neuroimaging in Psychiatry

Aberrant patterns of cognition, perception, and behavior seen in psychiatric disorders are thought to be driven by a complex interplay of neural processes that evolve at a rapid temporal scale. Understanding these dynamic processes in vivo in humans has been hampered by a trade-off between spatial and temporal resolutions inherent to current neuroimaging technology. A recent trend in psychiatric research has been the use of high temporal resolution imaging, particularly magnetoencephalography, often in conjunction with sophisticated machine learning decoding techniques. Developments here promise novel insights into the spatiotemporal dynamics of cognitive phenomena, including domains relevant to psychiatric illnesses such as reward and avoidance learning, memory, and planning. This review considers recent advances afforded by exploiting this increased spatiotemporal precision, with specific reference to applications that seek to drive a mechanistic understanding of psychopathology and the realization of preclinical translation.

Risk taking for potential losses but not gains increases with time of day

Humans exhibit distinct risk preferences when facing choices involving potential gains and losses. These preferences are believed to be subject to neuromodulatory influence, particularly from dopamine and serotonin. As neuromodulators manifest circadian rhythms, this suggests decision making under risk might be affected by time of day. Here, in a large subject sample collected using a smartphone application, we found that risky options with potential losses were increasingly chosen over the course of the day. We observed this result in both a within-subjects design (N = 2599) comparing risky options chosen earlier and later in the day in the same individuals, and in a between-subjects design (N = 26,720) showing our effect generalizes across ages and genders. Using computational modelling, we show this diurnal change in risk preference reflects a decrease in sensitivity to increasing losses, but no change was observed in the relative impacts of gains and losses on choice (i.e., loss aversion). Thus, our findings reveal a striking diurnal modulation in human decision making, a pattern with potential importance for real-life decisions that include voting, medical decisions, and financial investments.

Differential replay of reward and punishment paths predicts approach and avoidance

Neural replay is implicated in planning, where states relevant to a task goal are rapidly reactivated in sequence. It remains unclear whether, during planning, replay relates to an actual prospective choice. Here, using magnetoencephalography (MEG), we studied replay in human participants while they planned to either approach or avoid an uncertain environment containing paths leading to reward or punishment. We find evidence for forward sequential replay during planning, with rapid state-to-state transitions from 20 to 90 ms. Replay of rewarding paths was boosted, relative to aversive paths, before a decision to avoid and attenuated before a decision to approach. A trial-by-trial bias toward replaying prospective punishing paths predicted irrational decisions to approach riskier environments, an effect more pronounced in participants with higher trait anxiety. The findings indicate a coupling of replay with planned behavior, where replay prioritizes an online representation of a worst-case scenario for approaching or avoiding.

Disrupted state transition learning as a computational marker of compulsivity

BACKGROUND

Disorders involving compulsivity, fear, and anxiety are linked to beliefs that the world is less predictable. We lack a mechanistic explanation for how such beliefs arise. Here, we test a hypothesis that in people with compulsivity, fear, and anxiety, learning a probabilistic mapping between actions and environmental states is compromised.

METHODS

In Study 1 (n = 174), we designed a novel online task that isolated state transition learning from other facets of learning and planning. To determine whether this impairment is due to learning that is too fast or too slow, we estimated state transition learning rates by fitting computational models to two independent datasets, which tested learning in environments in which state transitions were either stable (Study 2: n = 1413) or changing (Study 3: n = 192).

RESULTS

Study 1 established that individuals with higher levels of compulsivity are more likely to demonstrate an impairment in state transition learning. Preliminary evidence here linked this impairment to a common factor comprising compulsivity and fear. Studies 2 and 3 showed that compulsivity is associated with learning that is too fast when it should be slow (i.e. when state transition are stable) and too slow when it should be fast (i.e. when state transitions change).

CONCLUSIONS

Together, these findings indicate that compulsivity is associated with a dysregulation of state transition learning, wherein the rate of learning is not well adapted to the task environment. Thus, dysregulated state transition learning might provide a key target for therapeutic intervention in compulsivity.

Distinct replay signatures for prospective decision-making and memory preservation

Theories of neural replay propose that it supports a range of functions, most prominently planning and memory consolidation. Here, we test the hypothesis that distinct signatures of replay in the same task are related to model-based decision-making ("planning") and memory preservation. We designed a reward learning task wherein participants utilized structure knowledge for model-based evaluation, while at the same time had to maintain knowledge of two independent and randomly alternating task environments. Using magnetoencephalography and multivariate analysis, we first identified temporally compressed sequential reactivation, or replay, both prior to choice and following reward feedback. Before choice, prospective replay strength was enhanced for the current task-relevant environment when a model-based planning strategy was beneficial. Following reward receipt, and consistent with a memory preservation role, replay for the alternative distal task environment was enhanced as a function of decreasing recency of experience with that environment. Critically, these planning and memory preservation relationships were selective to pre-choice and post-feedback periods, respectively. Our results provide support for key theoretical proposals regarding the functional role of replay and demonstrate that the relative strength of planning and memory-related signals are modulated by ongoing computational and task demands.

Reduced coupling between offline neural replay events and default mode network activation in schizophrenia

Schizophrenia is characterized by an abnormal resting state and default mode network brain activity. However, despite intense study, the mechanisms linking default mode network dynamics to neural computation remain elusive. During rest, sequential hippocampal reactivations, known as 'replay', are played out within default mode network activation windows, highlighting a potential role of replay-default mode network coupling in memory consolidation and model-based mental simulation. Here, we test a hypothesis of reduced replay-default mode network coupling in schizophrenia, using magnetoencephalography and a non-spatial sequence learning task designed to elicit off-task (i.e. resting state) neural replay. Participants with a diagnosis of schizophrenia (n = 28, mean age 28.2 years, range 20-40, 6 females, 13 not taking antipsychotic medication) and non-clinical control participants (n = 29, mean age 28.1 years, range 18-45, 6 females, matched at group level for age, intelligence quotient, gender, years in education and working memory) underwent a magnetoencephalography scan both during task completion and during a post-task resting state session. We used neural decoding to infer the time course of default mode network activation (time-delay embedding hidden Markov model) and spontaneous neural replay (temporally delayed linear modelling) in resting state magnetoencephalography data. Using multiple regression, we then quantified the extent to which default mode network activation was uniquely predicted by replay events that recapitulated the learned task sequences (i.e. 'task-relevant' replay-default mode network coupling). In control participants, replay-default mode network coupling was augmented following sequence learning, an augmentation that was specific for replay of task-relevant (i.e. learned) state transitions. This task-relevant replay-default mode network coupling effect was significantly reduced in schizophrenia (t(52) = 3.93, P = 0.018). Task-relevant replay-default mode network coupling predicted memory maintenance of learned sequences (ρ(52) = 0.31, P = 0.02). Importantly, reduced task-relevant replay-default mode network coupling in schizophrenia was not explained by differential replay or altered default mode network dynamics between groups nor by reference to antipsychotic exposure. Finally, task-relevant replay-default mode network coupling during rest correlated with stimulus-evoked default mode network modulation as measured in a separate task session. In the context of a proposed functional role of replay-default mode network coupling, our findings shed light on the functional significance of default mode network abnormalities in schizophrenia and provide for a consilience between task-based and resting state default mode network findings in this disorder.

Mobile Data Collection of Cognitive-Behavioral Tasks in Substance Use Disorders: Where Are We Now?

INTRODUCTION

Over the last decades, our understanding of the cognitive, motivational, and neural processes involved in addictive behavior has increased enormously. A plethora of laboratory-based and cross-sectional studies has linked cognitive-behavioral measures to between-subject differences in drinking behavior. However, such laboratory-based studies inevitably suffer from small sample sizes and the inability to link temporal fluctuations in task measures to fluctuations in real-life substance use. To overcome these problems, several existing behavioral tasks have been transferred to smartphones to allow studying cognition in the field.

METHOD

In this narrative review, we first summarize studies that used existing behavioral tasks in the laboratory and self-reports of substance use with ecological momentary assessment (EMA) in the field. Next, we review studies on psychometric properties of smartphone-based behavioral tasks. Finally, we review studies that used both smartphone-based tasks and self-reports with EMA in the field.

RESULTS

Overall, studies were scarce and heterogenous both in tasks and in study outcomes. Nevertheless, existing findings are promising and point toward several methodological recommendations: concerning psychometrics, studies show that - although more systematic studies are necessary - task validity and reliability can be improved, for example, by analyzing several measurement sessions at once rather than analyzing sessions separately. Studies that use tasks in the field, moreover, show that power can be improved by choosing sampling schemes that combine time-based with event-based sampling, rather than relying on time-based sampling alone. Increasing sampling frequency can further increase power. However, as this also increases the burden to participants, more research is necessary to determine the ideal sampling frequency for each task.

CONCLUSION

Although more research is necessary to systematically study both the psychometrics of smartphone-based tasks and the frequency at which task measures fluctuate, existing studies are promising and reveal important methodological recommendations useful for researchers interested in implementing behavioral tasks in EMA studies.

The impact of the initial COVID-19 outbreak on young adults' mental health: a longitudinal study of risk and resilience factors

Few studies assessing the effects of COVID-19 on mental health include prospective markers of risk and resilience necessary to understand and mitigate the combined impacts of the pandemic, lockdowns, and other societal responses. This population-based study of young adults includes individuals from the Neuroscience in Psychiatry Network (n = 2403) recruited from English primary care services and schools in 2012-2013 when aged 14-24. Participants were followed up three times thereafter, most recently during the initial outbreak of the COVID-19 outbreak when they were aged between 19 and 34. Repeated measures of psychological distress (K6) and mental wellbeing (SWEMWBS) were supplemented at the latest assessment by clinical measures of depression (PHQ-9) and anxiety (GAD-7). A total of 1000 participants, 42% of the original cohort, returned to take part in the COVID-19 follow-up; 737 completed all four assessments [mean age (SD), 25.6 (3.2) years; 65.4% female; 79.1% White]. Our findings show that the pandemic led to pronounced deviations from existing mental health-related trajectories compared to expected levels over approximately seven years. About three-in-ten young adults reported clinically significant depression (28.8%) or anxiety (27.6%) under current NHS guidelines; two-in-ten met clinical cut-offs for both. About 9% reported levels of psychological distress likely to be associated with serious functional impairments that substantially interfere with major life activities; an increase by 3% compared to pre-pandemic levels. Deviations from personal trajectories were not necessarily restricted to conventional risk factors; however, individuals with pre-existing health conditions suffered disproportionately during the initial outbreak of the COVID-19 pandemic. Resilience factors known to support mental health, particularly in response to adverse events, were at best mildly protective of individual psychological responses to the pandemic. Our findings underline the importance of monitoring the long-term effects of the ongoing pandemic on young adults' mental health, an age group at particular risk for the emergence of psychopathologies. Our findings further suggest that maintaining access to mental health care services during future waves, or potential new pandemics, is particularly crucial for those with pre-existing health conditions. Even though resilience factors known to support mental health were only mildly protective during the initial outbreak of the COVID-19 pandemic, it remains to be seen whether these factors facilitate mental health in the long term.

Functional neuroimaging in psychiatry and the case for failing better

Psychiatric disorders encompass complex aberrations of cognition and affect and are among the most debilitating and poorly understood of any medical condition. Current treatments rely primarily on interventions that target brain function (drugs) or learning processes (psychotherapy). A mechanistic understanding of how these interventions mediate their therapeutic effects remains elusive. From the early 1990s, non-invasive functional neuroimaging, coupled with parallel developments in the cognitive neurosciences, seemed to signal a new era of neurobiologically grounded diagnosis and treatment in psychiatry. Yet, despite three decades of intense neuroimaging research, we still lack a neurobiological account for any psychiatric condition. Likewise, functional neuroimaging plays no role in clinical decision making. Here, we offer a critical commentary on this impasse and suggest how the field might fare better and deliver impactful neurobiological insights.

Serotonin modulates asymmetric learning from reward and punishment in healthy human volunteers

Instrumental learning is driven by a history of outcome success and failure. Here, we examined the impact of serotonin on learning from positive and negative outcomes. Healthy human volunteers were assessed twice, once after acute (single-dose), and once after prolonged (week-long) daily administration of the SSRI citalopram or placebo. Using computational modelling, we show that prolonged boosting of serotonin enhances learning from punishment and reduces learning from reward. This valence-dependent learning asymmetry increases subjects’ tendency to avoid actions as a function of cumulative failure without leading to detrimental, or advantageous, outcomes. By contrast, no significant modulation of learning was observed following acute SSRI administration. However, differences between the effects of acute and prolonged administration were not significant. Overall, these findings may help explain how serotonergic agents impact on mood disorders.

Two factors can drive learning: punishment of failures and reward of successes. Serotonin induces a valence-dependent learning asymmetry, as revealed by prolonged administering of SSRIs to healthy participants in a gambling task.

Low self-esteem and the formation of global self-performance estimates in emerging adulthood

High self-esteem, an overall positive evaluation of self-worth, is a cornerstone of mental health. Previously we showed that people with low self-esteem differentially construct beliefs about momentary self-worth derived from social feedback. However, it remains unknown whether these anomalies extend to constructing beliefs about self-performance in a non-social context, in the absence of external feedback. Here, we examined this question using a novel behavioral paradigm probing subjects' self-performance estimates with or without external feedback. We analyzed data from young adults (N = 57) who were selected from a larger community sample (N = 2402) on the basis of occupying the bottom or top 10% of a reported self-esteem distribution. Participants performed a series of short blocks involving two perceptual decision-making tasks with varying degrees of difficulty, with or without feedback. At the end of each block, they had to decide on which task they thought they performed best, and gave subjective task ratings, providing two measures of self-performance estimates. We found no robust evidence of differences in objective performance between high and low self-esteem participants. Nevertheless, low self-esteem participants consistently underestimated their performance as expressed in lower subjective task ratings relative to high self-esteem participants. These results provide an initial window onto how cognitive processes underpinning the construction of self-performance estimates across different contexts map on to global dispositions relevant to mental health such as self-esteem.

Humans perseverate on punishment avoidance goals in multigoal reinforcement learning

Managing multiple goals is essential to adaptation, yet we are only beginning to understand computations by which we navigate the resource demands entailed in so doing. Here, we sought to elucidate how humans balance reward seeking and punishment avoidance goals, and relate this to variation in its expression within anxious individuals. To do so, we developed a novel multigoal pursuit task that includes trial-specific instructed goals to either pursue reward (without risk of punishment) or avoid punishment (without the opportunity for reward). We constructed a computational model of multigoal pursuit to quantify the degree to which participants could disengage from the pursuit goals when instructed to, as well as devote less model-based resources toward goals that were less abundant. In general, participants (n = 192) were less flexible in avoiding punishment than in pursuing reward. Thus, when instructed to pursue reward, participants often persisted in avoiding features that had previously been associated with punishment, even though at decision time these features were unambiguously benign. In a similar vein, participants showed no significant downregulation of avoidance when punishment avoidance goals were less abundant in the task. Importantly, we show preliminary evidence that individuals with chronic worry may have difficulty disengaging from punishment avoidance when instructed to seek reward. Taken together, the findings demonstrate that people avoid punishment less flexibly than they pursue reward. Future studies should test in larger samples whether a difficulty to disengage from punishment avoidance contributes to chronic worry.

Relationship Between Replay-Associated Ripples and Hippocampal N-Methyl-D-Aspartate Receptors: Preliminary Evidence From a PET-MEG Study in Schizophrenia

Background and Hypotheses

Hippocampal replay and associated high-frequency ripple oscillations are among the best-characterized phenomena in resting brain activity. Replay/ripples support memory consolidation and relational inference, and are regulated by N-methyl-D-aspartate receptors (NMDARs). Schizophrenia has been associated with both replay/ripple abnormalities and NMDAR hypofunction in both clinical samples and genetic mouse models, although the relationship between these 2 facets of hippocampal function has not been tested in humans.

Study Design

Here, we avail of a unique multimodal human neuroimaging data set to investigate the relationship between the availability of (intrachannel) NMDAR binding sites in hippocampus, and replay-associated ripple power, in 16 participants (7 nonclinical participants and 9 people with a diagnosis of schizophrenia, PScz). Each participant had both a [¹⁸F]GE-179 positron emission tomography (PET) scan (to measure NMDAR availability, V _T ) and a magnetoencephalography (MEG) scan (to measure offline neural replay and associated high-frequency ripple oscillations, using Temporally Delayed Linear Modeling).

Study Results

We show a positive relationship between hippocampal NMDAR availability and replay-associated ripple power. This linkage was evident across control participants (r(5) = .94, P = .002) and PScz (r(7) = .70, P = .04), with no group difference.

Conclusions

Our findings provide preliminary evidence for a relationship between hippocampal NMDAR availability and replay-associated ripple power in humans, and haverelevance for NMDAR hypofunction theories of schizophrenia.

Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference

Dopamine is implicated in representing model-free (MF) reward prediction errors a as well as influencing model-based (MB) credit assignment and choice. Putative cooperative interactions between MB and MF systems include a guidance of MF credit assignment by MB inference. Here, we used a double-blind, placebo-controlled, within-subjects design to test an hypothesis that enhancing dopamine levels boosts the guidance of MF credit assignment by MB inference. In line with this, we found that levodopa enhanced guidance of MF credit assignment by MB inference, without impacting MF and MB influences directly. This drug effect correlated negatively with a dopamine-dependent change in purely MB credit assignment, possibly reflecting a trade-off between these two MB components of behavioural control. Our findings of a dopamine boost in MB inference guidance of MF learning highlight a novel DA influence on MB-MF cooperative interactions.

Assigning the right credit to the wrong action: compulsivity in the general population is associated with augmented outcome-irrelevant value-based learning

Compulsive behavior is enacted under a belief that a specific act controls the likelihood of an undesired future event. Compulsive behaviors are widespread in the general population despite having no causal relationship with events they aspire to influence. In the current study, we tested whether there is an increased tendency to assign value to aspects of a task that do not predict an outcome (i.e., outcome-irrelevant learning) among individuals with compulsive tendencies. We studied 514 healthy individuals who completed self-report compulsivity, anxiety, depression, and schizotypal measurements, and a well-established reinforcement-learning task (i.e., the two-step task). As expected, we found a positive relationship between compulsivity and outcome-irrelevant learning. Specifically, individuals who reported having stronger compulsive tendencies (e.g., washing, checking, grooming) also tended to assign value to response keys and stimuli locations that did not predict an outcome. Controlling for overall goal-directed abilities and the co-occurrence of anxious, depressive, or schizotypal tendencies did not impact these associations. These findings indicate that outcome-irrelevant learning processes may contribute to the expression of compulsivity in a general population setting. We highlight the need for future research on the formation of non-veridical action-outcome associations as a factor related to the occurrence and maintenance of compulsive behavior.

Dreading the pain of others? Altruistic responses to others' pain underestimate dread

A dislike of waiting for pain, aptly termed 'dread', is so great that people will increase pain to avoid delaying it. However, despite many accounts of altruistic responses to pain in others, no previous studies have tested whether people take delay into account when attempting to ameliorate others' pain. We examined the impact of delay in 2 experiments where participants (total N = 130) specified the intensity and delay of pain either for themselves or another person. Participants were willing to increase the experimental pain of another participant to avoid delaying it, indicative of dread, though did so to a lesser extent than was the case for their own pain. We observed a similar attenuation in dread when participants chose the timing of a hypothetical painful medical treatment for a close friend or relative, but no such attenuation when participants chose for a more distant acquaintance. A model in which altruism is biased to privilege pain intensity over the dread of pain parsimoniously accounts for these findings. We refer to this underestimation of others' dread as a 'Dread Empathy Gap'.

Multi-Round Trust Game Quantifies Inter-Individual Differences in Social Exchange from Adolescence to Adulthood

Investing in strangers in a socio-economic exchange is risky, as we may be uncertain whether they will reciprocate. Nevertheless, the potential rewards for cooperating can be great. Here, we used a cross sectional sample (n = 784) to study how the challenges of cooperation versus defection are negotiated across an important period of the lifespan: from adolescence to young adulthood (ages 14 to 25). We quantified social behaviour using a multi round investor-trustee task, phenotyping individuals using a validated model whose parameters characterise patterns of real exchange and constitute latent social characteristics. We found highly significant differences in investment behaviour according to age, sex, socio-economic status and IQ. Consistent with the literature, we showed an overall trend towards higher trust from adolescence to young adulthood but, in a novel finding, we characterized key cognitive mechanisms explaining this, especially regarding socio-economic risk aversion. Males showed lower risk-aversion, associated with greater investments. We also found that inequality aversion was higher in females and, in a novel relation, that socio-economic deprivation was associated with more risk averse play.

Opportunities, risks and challenges in global mental health and population neuroscience: a case of Sino-German cooperation

Large scale prospective cohorts have now been established across several countries, and continents, and among the aims include an assessment of the developmental trajectory of mental disorders. This level of international cooperation helps transfer research findings to new social contexts as well as enabling an assessment of which findings can be replicated, and which interventions are most effective, in different social and cultural settings. However, data sharing across different regional and national health care systems requires a careful consideration of different standards in ethical research, data protection and patient care, including respect for patients' rights, in cooperating jurisdictions. In our review, we discuss ethical, legal and practical challenges associated with such cooperation with a focus on research participants, specifically patient recruitment, by considering the instance of China and Germany. Our broader aim is to promote international cooperation by identifying key challenges that arise in international cooperation, and to facilitate an exchange in relation to legal and practical approaches.

Impaired neural replay of inferred relationships in schizophrenia

An ability to build structured mental maps of the world underpins our capacity to imagine relationships between objects that extend beyond experience. In rodents, such representations are supported by sequential place cell reactivations during rest, known as replay. Schizophrenia is proposed to reflect a compromise in structured mental representations, with animal models reporting abnormalities in hippocampal replay and associated ripple activity during rest. Here, utilizing magnetoencephalography (MEG), we tasked patients with schizophrenia and control participants to infer unobserved relationships between objects by reorganizing visual experiences containing these objects. During a post-task rest session, controls exhibited fast spontaneous neural reactivation of presented objects that replayed inferred relationships. Replay was coincident with increased ripple power in hippocampus. Patients showed both reduced replay and augmented ripple power relative to controls, convergent with findings in animal models. These abnormalities are linked to impairments in behavioral acquisition and subsequent neural representation of task structure.

Efficiency and prioritization of inference-based credit assignment

Organisms adapt to their environments by learning to approach states that predict rewards and avoid states associated with punishments. Knowledge about the affective value of states often relies on credit assignment (CA), whereby state values are updated on the basis of reward feedback. Remarkably, humans assign credit to states that are not observed but are instead inferred based on a cognitive map that represents structural knowledge of an environment. A pertinent example is authors attempting to infer the identity of anonymous reviewers to assign them credit or blame and, on this basis, inform future referee recommendations. Although inference is cognitively costly, it is unknown how it influences CA or how it is apportioned between hidden and observable states (for example, both anonymous and revealed reviewers). We addressed these questions in a task that provided choices between lotteries where each led to a unique pair of occasionally rewarding outcome states. On some trials, both states were observable (rendering inference nugatory), whereas on others, the identity of one of the states was concealed. Importantly, by exploiting knowledge of choice-state associations, subjects could infer the identity of this hidden state. We show that having to perform inference reduces state-value updates. Strikingly, and in violation of normative theories, this reduction in CA was selective for the observed outcome alone. These findings have implications for the operation of putative cognitive maps.

Explaining distortions in metacognition with an attractor network model of decision uncertainty

Metacognition is the ability to reflect on, and evaluate, our cognition and behaviour. Distortions in metacognition are common in mental health disorders, though the neural underpinnings of such dysfunction are unknown. One reason for this is that models of key components of metacognition, such as decision confidence, are generally specified at an algorithmic or process level. While such models can be used to relate brain function to psychopathology, they are difficult to map to a neurobiological mechanism. Here, we develop a biologically-plausible model of decision uncertainty in an attempt to bridge this gap. We first relate the model's uncertainty in perceptual decisions to standard metrics of metacognition, namely mean confidence level (bias) and the accuracy of metacognitive judgments (sensitivity). We show that dissociable shifts in metacognition are associated with isolated disturbances at higher-order levels of a circuit associated with self-monitoring, akin to neuropsychological findings that highlight the detrimental effect of prefrontal brain lesions on metacognitive performance. Notably, we are able to account for empirical confidence judgements by fitting the parameters of our biophysical model to first-order performance data, specifically choice and response times. Lastly, in a reanalysis of existing data we show that self-reported mental health symptoms relate to disturbances in an uncertainty-monitoring component of the network. By bridging a gap between a biologically-plausible model of confidence formation and observed disturbances of metacognition in mental health disorders we provide a first step towards mapping theoretical constructs of metacognition onto dynamical models of decision uncertainty. In doing so, we provide a computational framework for modelling metacognitive performance in settings where access to explicit confidence reports is not possible.

Model-based aversive learning in humans is supported by preferential task state reactivation

Harm avoidance is critical for survival, yet little is known regarding the neural mechanisms supporting avoidance in the absence of trial-and-error experience. Flexible avoidance may be supported by a mental model (i.e., model-based), a process for which neural reactivation and sequential replay have emerged as candidate mechanisms. During an aversive learning task, combined with magnetoencephalography, we show prospective and retrospective reactivation during planning and learning, respectively, coupled to evidence for sequential replay. Specifically, when individuals plan in an aversive context, we find preferential reactivation of subsequently chosen goal states. Stronger reactivation is associated with greater hippocampal theta power. At outcome receipt, unchosen goal states are reactivated regardless of outcome valence. Replay of paths leading to goal states was modulated by outcome valence, with aversive outcomes associated with stronger reverse replay than safe outcomes. Our findings are suggestive of avoidance involving simulation of unexperienced states through hippocampally mediated reactivation and replay.

Decision-making ability, psychopathology, and brain connectivity

Decision-making is a cognitive process of central importance for the quality of our lives. Here, we ask whether a common factor underpins our diverse decision-making abilities. We obtained 32 decision-making measures from 830 young people and identified a common factor that we call "decision acuity," which was distinct from IQ and reflected a generic decision-making ability. Decision acuity was decreased in those with aberrant thinking and low general social functioning. Crucially, decision acuity and IQ had dissociable brain signatures, in terms of their associated neural networks of resting-state functional connectivity. Decision acuity was reliably measured, and its relationship with functional connectivity was also stable when measured in the same individuals 18 months later. Thus, our behavioral and brain data identify a new cognitive construct that underpins decision-making ability across multiple domains. This construct may be important for understanding mental health, particularly regarding poor social function and aberrant thought patterns.

Temporally delayed linear modelling (TDLM) measures replay in both animals and humans

There are rich structures in off-task neural activity which are hypothesized to reflect fundamental computations across a broad spectrum of cognitive functions. Here, we develop an analysis toolkit - temporal delayed linear modelling (TDLM) - for analysing such activity. TDLM is a domain-general method for finding neural sequences that respect a pre-specified transition graph. It combines nonlinear classification and linear temporal modelling to test for statistical regularities in sequences of task-related reactivations. TDLM is developed on the non-invasive neuroimaging data and is designed to take care of confounds and maximize sequence detection ability. Notably, as a linear framework, TDLM can be easily extended, without loss of generality, to capture rodent replay in electrophysiology, including in continuous spaces, as well as addressing second-order inference questions, for example, its temporal and spatial varying pattern. We hope TDLM will advance a deeper understanding of neural computation and promote a richer convergence between animal and human neuroscience.

Experience replay is associated with efficient nonlocal learning

To make effective decisions, people need to consider the relationship between actions and outcomes. These are often separated by time and space. The neural mechanisms by which disjoint actions and outcomes are linked remain unknown. One promising hypothesis involves neural replay of nonlocal experience. Using a task that segregates direct from indirect value learning, combined with magnetoencephalography, we examined the role of neural replay in human nonlocal learning. After receipt of a reward, we found significant backward replay of nonlocal experience, with a 160-millisecond state-to-state time lag, which was linked to efficient learning of action values. Backward replay and behavioral evidence of nonlocal learning were more pronounced for experiences of greater benefit for future behavior. These findings support nonlocal replay as a neural mechanism for solving complex credit assignment problems during learning.

Transdiagnostic neuroimaging markers of psychiatric risk: A narrative review

•

We review the literature on neural correlates of a general psychopathology factor

•

General psychopathology relates to structural and functional neurodevelopment

•

Disrupted network connectivity maturation may underlie psychiatric vulnerability

Several decades of neuroimaging research in psychiatry have shed light on structural and functional neural abnormalities associated with individual psychiatric disorders. However, there is increasing evidence for substantial overlap in the patterns of neural dysfunction seen across disorders, suggesting that risk for psychiatric illness may be shared across diagnostic boundaries. Gaining insights on the existence of shared neural mechanisms which may transdiagnostically underlie psychopathology is important for psychiatric research in order to tease apart the unique and common aspects of different disorders, but also clinically, so as to help identify individuals early on who may be biologically vulnerable to psychiatric disorder in general. In this narrative review, we first evaluate recent studies investigating the functional and structural neural correlates of a general psychopathology factor, which is thought to reflect the shared variance across common mental health symptoms and therefore index psychiatric vulnerability. We then link insights from this research to existing meta-analytic evidence for shared patterns of neural dysfunction across categorical psychiatric disorders. We conclude by providing an integrative account of vulnerability to mental illness, whereby delayed or disrupted maturation of large-scale networks (particularly default-mode, executive, and sensorimotor networks), and more generally between-network connectivity, results in a compromised ability to integrate and switch between internally and externally focused tasks.

Overcoming Pavlovian bias in semantic space

Action is invigorated in the presence of reward-predicting stimuli and inhibited in the presence of punishment-predicting stimuli. Although valuable as a heuristic, this Pavlovian bias can also lead to maladaptive behaviour and is implicated in addiction. Here we explore whether Pavlovian bias can be overcome through training. Across five experiments, we find that Pavlovian bias is resistant to unlearning under most task configurations. However, we demonstrate that when subjects engage in instrumental learning in a verbal semantic space, as opposed to a motoric space, not only do they exhibit the typical Pavlovian bias, but this Pavlovian bias diminishes with training. Our results suggest that learning within the semantic space is necessary, but not sufficient, for subjects to unlearn their Pavlovian bias, and that other task features, such as gamification and spaced stimulus presentation may also be necessary. In summary, we show that Pavlovian bias, whilst robust, is susceptible to change with experience, but only under specific environmental conditions.

Model based planners reflect on their model-free propensities

Dual-reinforcement learning theory proposes behaviour is under the tutelage of a retrospective, value-caching, model-free (MF) system and a prospective-planning, model-based (MB), system. This architecture raises a question as to the degree to which, when devising a plan, a MB controller takes account of influences from its MF counterpart. We present evidence that such a sophisticated self-reflective MB planner incorporates an anticipation of the influences its own MF-proclivities exerts on the execution of its planned future actions. Using a novel bandit task, wherein subjects were periodically allowed to design their environment, we show that reward-assignments were constructed in a manner consistent with a MB system taking account of its MF propensities. Thus, in the task participants assigned higher rewards to bandits that were momentarily associated with stronger MF tendencies. Our findings have implications for a range of decision making domains that includes drug abuse, pre-commitment, and the tension between short and long-term decision horizons in economics.

Dogmatism manifests in lowered information search under uncertainty

When knowledge is scarce, it is adaptive to seek further information to resolve uncertainty and obtain a more accurate worldview. Biases in such information-seeking behavior can contribute to the maintenance of inaccurate views. Here, we investigate whether predispositions for uncertainty-guided information seeking relate to individual differences in dogmatism, a phenomenon linked to entrenched beliefs in political, scientific, and religious discourse. We addressed this question in a perceptual decision-making task, allowing us to rule out motivational factors and isolate the role of uncertainty. In two independent general population samples (n = 370 and n = 364), we show that more dogmatic participants are less likely to seek out new information to refine an initial perceptual decision, leading to a reduction in overall belief accuracy despite similar initial decision performance. Trial-by-trial modeling revealed that dogmatic participants placed less reliance on internal signals of uncertainty (confidence) to guide information search, rendering them less likely to seek additional information to update beliefs derived from weak or uncertain initial evidence. Together, our results highlight a cognitive mechanism that may contribute to the formation of dogmatic worldviews.

Compulsivity is linked to reduced adolescent development of goal-directed control and frontostriatal functional connectivity

A characteristic of adaptive behavior is its goal-directed nature. An ability to act in a goal-directed manner is progressively refined during development, but this refinement can be impacted by the emergence of psychiatric disorders. Disorders of compulsivity have been framed computationally as a deficit in model-based control, and have been linked also to abnormal frontostriatal connectivity. However, the developmental trajectory of model-based control, including an interplay between its maturation and an emergence of compulsivity, has not been characterized. Availing of a large sample of healthy adolescents (n = 569) aged 14 to 24 y, we show behaviorally that over the course of adolescence there is a within-person increase in model-based control, and this is more pronounced in younger participants. Using a bivariate latent change score model, we provide evidence that the presence of higher compulsivity traits is associated with an atypical profile of this developmental maturation in model-based control. Resting-state fMRI data from a subset of the behaviorally assessed subjects (n = 230) revealed that compulsivity is associated with a less pronounced change of within-subject developmental remodeling of functional connectivity, specifically between the striatum and a frontoparietal network. Thus, in an otherwise clinically healthy population sample, in early development, individual differences in compulsivity are linked to the developmental trajectory of model-based control and a remodeling of frontostriatal connectivity.

Social discounting of pain

Impatience can be formalized as a delay discount rate, describing how the subjective value of reward decreases as it is delayed. By analogy, selfishness can be formalized as a social discount rate, representing how the subjective value of rewarding another person decreases with increasing social distance. Delay and social discount rates for reward are correlated across individuals. However no previous work has examined whether this relationship also holds for aversive outcomes. Neither has previous work described a functional form for social discounting of pain in humans. This is a pertinent question, since preferences over aversive outcomes formally diverge from those for reward. We addressed this issue in an experiment in which healthy adult participants (N = 67) chose the timing and intensity of hypothetical pain for themselves and others. In keeping with previous studies, participants showed a strong preference for immediate over delayed pain. Participants showed greater concern for pain in close others than for their own pain, though this hyperaltruism was steeply discounted with increasing social distance. Impatience for pain and social discounting of pain were weakly correlated across individuals. Our results extend a link between impatience and selfishness to the aversive domain.

Towards formal models of psychopathological traits that explain symptom trajectories

BACKGROUND

A dominant methodology in contemporary clinical neuroscience is the use of dimensional self-report questionnaires to measure features such as psychological traits (e.g., trait anxiety) and states (e.g., depressed mood). These dimensions are then mapped to biological measures and computational parameters. Researchers pursuing this approach tend to equate a symptom inventory score (plus noise) with some latent psychological trait.

MAIN TEXT

We argue this approach implies weak, tacit, models of traits that provide fixed predictions of individual symptoms, and thus cannot account for symptom trajectories within individuals. This problem persists because (1) researchers are not familiarized with formal models that relate internal traits to within-subject symptom variation and (2) rely on an assumption that trait self-report inventories accurately indicate latent traits. To address these concerns, we offer a computational model of trait depression that demonstrates how parameters instantiating a given trait remain stable while manifest symptom expression varies predictably. We simulate patterns of mood variation from both the computational model and the standard self-report model and describe how to quantify the relative validity of each model using a Bayesian procedure.

CONCLUSIONS

Ultimately, we would urge a tempering of a reliance on self-report inventories and recommend a shift towards developing mechanistic trait models that can explain within-subject symptom dynamics.

Associations between aversive learning processes and transdiagnostic psychiatric symptoms in a general population sample

Symptom expression in psychiatric conditions is often linked to altered threat perception, however how computational mechanisms that support aversive learning relate to specific psychiatric symptoms remains undetermined. We answer this question using an online game-based aversive learning task together with measures of common psychiatric symptoms in 400 subjects. We show that physiological symptoms of anxiety and a transdiagnostic compulsivity-related factor are associated with enhanced safety learning, as measured using a probabilistic computational model, while trait cognitive anxiety symptoms are associated with enhanced learning from danger. We use data-driven partial least squares regression to identify two separable components across behavioural and questionnaire data: one linking enhanced safety learning and lower estimated uncertainty to physiological anxiety, compulsivity, and impulsivity; the other linking enhanced threat learning and heightened uncertainty estimation to symptoms of depression and social anxiety. Our findings implicate aversive learning processes in the expression of psychiatric symptoms that transcend diagnostic boundaries.

Schizotypy-Related Magnetization of Cortex in Healthy Adolescence Is Colocated With Expression of Schizophrenia-Related Genes

BACKGROUND

Genetic risk is thought to drive clinical variation on a spectrum of schizophrenia-like traits, but the underlying changes in brain structure that mechanistically link genomic variation to schizotypal experience and behavior are unclear.

METHODS

We assessed schizotypy using a self-reported questionnaire and measured magnetization transfer as a putative microstructural magnetic resonance imaging marker of intracortical myelination in 68 brain regions in 248 healthy young people (14-25 years of age). We used normative adult brain gene expression data and partial least squares analysis to find the weighted gene expression pattern that was most colocated with the cortical map of schizotypy-related magnetization.

RESULTS

Magnetization was significantly correlated with schizotypy in the bilateral posterior cingulate cortex and precuneus (and for disorganized schizotypy, also in medial prefrontal cortex; all false discovery rate-corrected ps < .05), which are regions of the default mode network specialized for social and memory functions. The genes most positively weighted on the whole-genome expression map colocated with schizotypy-related magnetization were enriched for genes that were significantly downregulated in two prior case-control histological studies of brain gene expression in schizophrenia. Conversely, the most negatively weighted genes were enriched for genes that were transcriptionally upregulated in schizophrenia. Positively weighted (downregulated) genes were enriched for neuronal, specifically interneuronal, affiliations and coded a network of proteins comprising a few highly interactive "hubs" such as parvalbumin and calmodulin.

CONCLUSIONS

Microstructural magnetic resonance imaging maps of intracortical magnetization can be linked to both the behavioral traits of schizotypy and prior histological data on dysregulated gene expression in schizophrenia.

The role of dopamine in dynamic effort-reward integration

When deciding to act, the neurotransmitter dopamine is implicated in a valuation of prospective effort and reward. However, its role in dynamic effort-reward integration during action, a process central to everyday behaviour, remains unclear. In a placebo-controlled, within-subject, study, we probed the impact of increasing brain dopamine levels (150 mg of levodopa) and blocking dopamine receptors (1.5 mg of haloperidol) in the context of a novel dynamic effort task in healthy human subjects. We show that modulating homoeostatic dopamine balance distinctly alters implicit and explicit effort allocation as a function of instantaneous reward. Pharmacologically boosting dopamine enhanced motor vigour, reflected in an implicit increase in effort allocation for high rewards. Conversely, pharmacological blockade of dopamine attenuated sensitivity to differences in reward context, reflected in reduced strategic effort discounting. These findings implicate dopamine in an integration of momentary physical experience and instantaneous reward, suggesting a key role of dopamine in acting to maximise reward on the fly.

Episodic memory retrieval success is associated with rapid replay of episode content

Retrieval of everyday experiences is fundamental for informing our future decisions. The fine-grained neurophysiological mechanisms that support such memory retrieval are largely unknown. We studied participants who first experienced, without repetition, unique multicomponent 40-80-s episodes. One day later, they engaged in cued retrieval of these episodes while undergoing magnetoencephalography. By decoding individual episode elements, we found that trial-by-trial successful retrieval was supported by the sequential replay of episode elements, with a temporal compression factor of >60. The direction of replay supporting retrieval, either backward or forward, depended on whether the task goal was to retrieve elements of an episode that followed or preceded, respectively, a retrieval cue. This sequential replay was weaker in very-high-performing participants, in whom instead we found evidence for simultaneous clustered reactivation. Our results demonstrate that memory-mediated decisions are supported by a rapid replay mechanism that can flexibly shift in direction in response to task goals.

Predictors of risky foraging behaviour in healthy young people

During adolescence and early adulthood, learning when to avoid threats and when to pursue rewards becomes crucial. Using a risky foraging task, we investigated individual differences in this dynamic across 781 individuals aged 14-24 years who were split into a hypothesis-generating discovery sample and a hold-out confirmation sample. Sex was the most important predictor of cautious behaviour and performance. Males earned one standard deviation (or 20%) more reward than females, collected more reward when there was little to lose and reduced foraging to the same level as females when potential losses became high. Other independent predictors of cautiousness and performance were self-reported daringness, IQ and self-reported cognitive complexity. We found no evidence for an impact of age or maturation. Thus, maleness, a high IQ or self-reported cognitive complexity, and self-reported daringness predicted greater success in risky foraging, possibly due to better exploitation of low-risk opportunities in high-risk environments.