Computational validity: using computation to translate behaviours across species

Striatal stimulation enhances cognitive control and evidence processing in rodents and humans

Brain disorders, in particular mental disorders, might be effectively treated by direct electrical brain stimulation, but clinical progress requires understanding of therapeutic mechanisms. Animal models have not helped, because there are no direct animal models of mental illness. Here, we propose a potential path past this roadblock, by leveraging a common ingredient of most mental disorders: impaired cognitive control. We previously showed that deep brain stimulation (DBS) improves cognitive control in humans. We now reverse translate that result using a set-shifting task in rats. DBS-like stimulation of the midstriatum improved reaction times without affecting accuracy, mirroring our human findings. Impulsivity, motivation, locomotor, and learning effects were ruled out through companion tasks and model-based analyses. To identify the specific cognitive processes affected, we applied reinforcement learning drift-diffusion modeling. This approach revealed that DBS-like stimulation enhanced evidence accumulation rates and lowered decision thresholds, improving domain-general cognitive control. Reanalysis of prior human data showed that the same mechanism applies in humans. This reverse/forward translational model could have near-term implications for clinical DBS practice and future trial design.

From palm to practice: prescription digital therapeutics for mental and brain health at the National Institutes of Health

Prescription Digital Therapeutics (PDTs) are emerging as promising tools for treating and managing mental and brain health conditions within the context of daily life. This commentary distinguishes PDTs from other Software as Medical Devices (SaMD) and explores their integration into mental and brain health treatments. We focus on research programs and support from the National Institutes of Health (NIH), discussing PDT research supported by the NIH's National Institute on Child Health and Development (NICHD), National Institute of Mental Health (NIMH), and National Institute on Aging (NIA). We present a hierarchical natural language processing topic analysis of NIH-funded digital therapeutics research projects. We delineate the PDT landscape across different mental and brain health disorders while highlighting opportunities and challenges. Additionally, we discuss the research foundation for PDTs, the unique therapeutic approaches they employ, and potential strategies to improve their validity, reliability, safety, and effectiveness. Finally, we address the research and collaborations necessary to propel the field forward, ultimately enhancing patient care through innovative digital health solutions.

A Double Hit of Social and Economic Stress in Mice Precipitates Changes in Decision-Making Strategies

BACKGROUND

Economic stress can serve as a second hit for people who have already accumulated a history of adverse life experiences. How one recovers from a setback is a core feature of resilience but is seldom captured in animal studies.

METHODS

We challenged mice in a novel 2-hit stress model by first exposing them to chronic social defeat stress and then testing adaptations to increasing reward scarcity on a neuroeconomic task. Mice were tested across months on the Restaurant Row task, during which they foraged daily for their primary source of food while on a limited time budget in a closed-economy system. An abrupt transition into a reward-scarce environment elicits an economic challenge, precipitating a drop in food intake and body weight to which mice must respond to survive.

RESULTS

We found that mice with a history of social stress mounted a robust behavioral response to this economic challenge that was achieved through a complex redistribution of time allocation among competing opportunities. Interestingly, we found that mice with a history of social defeat displayed changes in the development of decision-making policies during the recovery process that are important not only for ensuring food security necessary for survival but also prioritizing subjective value and that these changes emerged only for certain types of choices.

CONCLUSIONS

These findings indicate that an individual's capacity to recover from economic challenges depends on that person's prior history of stress and can affect multiple decision-making aspects of subjective well-being, thus highlighting a motivational balance that may be altered in stress-related disorders such as depression.

Understanding How Acute Alcohol Impacts Neural Encoding in the Rodent Brain

Alcohol impacts neural circuitry throughout the brain and has wide-ranging effects on the biophysical properties of neurons in these circuits. Articulating how these wide-ranging effects might eventually result in altered computational properties has the potential to provide a tractable working model of how alcohol alters neural encoding. This chapter reviews what is currently known about how acute alcohol influences neural activity in cortical, hippocampal, and dopaminergic circuits as these have been the primary focus of understanding how alcohol alters neural computation. While other neural systems have been the focus of exhaustive work on this topic, these brain regions are the ones where in vivo neural recordings are available, thus optimally suited to make the link between changes in neural activity and behavior. Rodent models have been key in developing an understanding of how alcohol impacts the function of these circuits, and this chapter therefore focuses on work from mice and rats. While progress has been made, it is critical to understand the challenges and caveats associated with experimental procedures, especially when performed in vivo, which are designed to answer this question and if/how to translate these data to humans. The hypothesis is discussed that alcohol impairs the ability of neural circuits to acquire states of neural activity that are transiently elevated and characterized by increased complexity. It is hypothesized that these changes are distinct from the traditional view of alcohol being a depressant of neural activity in the forebrain.

Thinking computationally in translational psychiatry. A commentary on Neville et al. (2024)

There is a growing focus on the computational aspects of psychiatric disorders in humans. This idea also is gaining traction in nonhuman animal studies. Commenting on a new comprehensive overview of the benefits of applying this approach in translational research by Neville et al. (Cognitive Affective & Behavioral Neuroscience 1-14, 2024), we discuss the implications for translational model validity within this framework. We argue that thinking computationally in translational psychiatry calls for a change in the way that we evaluate animal models of human psychiatric processes, with a shift in focus towards symptom-producing computations rather than the symptoms themselves. Further, in line with Neville et al.'s adoption of the reinforcement learning framework to model animal behaviour, we illustrate how this approach can be applied beyond simple decision-making paradigms to model more naturalistic behaviours.

Current and Future Approaches to Pediatric Anxiety Disorder Treatment

This overview critically appraises the literature on the treatment of pediatric anxiety disorders. The two established treatments for these conditions comprise cognitive-behavioral therapy (CBT) and antidepressant medications. Many youths receiving these treatments fail to achieve remission, which creates a need for new treatments. After summarizing the literature on CBT and currently available medications, the authors describe research that lays a foundation for improvements in the treatment of pediatric anxiety disorders. This foundation leverages neuroscientific investigations, also described in the overview, which provide insights on mechanisms of successful treatment.

Bayesian Decision-Making Under Uncertainty in Borderline Personality Disorder

Bayesian decision theory suggests that optimal decision-making should use and weigh prior beliefs with current information, according to their relative uncertainties. However, some characteristics of borderline personality disorder (BPD) patients, such as fast, drastic changes in the overall perception of themselves and others, suggest they may be underrelying on priors. Here, we investigated if BPD patients have a general deficit in relying on or combining prior with current information. We analyzed this by having BPD patients (n = 23) and healthy controls (n = 18) perform a coin-catching sensorimotor task with varying levels of prior and current information uncertainty. Our results indicate that BPD patients learned and used prior information and combined it with current information in a qualitatively Bayesian-like way. Our results show that, at least in a lower-level, nonsocial sensorimotor task, BPD patients can appropriately use both prior and current information, illustrating that potential deficits using priors may not be widespread or domain-general.

Closing the loop in psychiatric deep brain stimulation: physiology, psychometrics, and plasticity

Deep brain stimulation (DBS) is an invasive approach to precise modulation of psychiatrically relevant circuits. Although it has impressive results in open-label psychiatric trials, DBS has also struggled to scale to and pass through multi-center randomized trials. This contrasts with Parkinson disease, where DBS is an established therapy treating thousands of patients annually. The core difference between these clinical applications is the difficulty of proving target engagement, and of leveraging the wide range of possible settings (parameters) that can be programmed in a given patient's DBS. In Parkinson's, patients' symptoms change rapidly and visibly when the stimulator is tuned to the correct parameters. In psychiatry, those same changes take days to weeks, limiting a clinician's ability to explore parameter space and identify patient-specific optimal settings. I review new approaches to psychiatric target engagement, with an emphasis on major depressive disorder (MDD). Specifically, I argue that better engagement may come by focusing on the root causes of psychiatric illness: dysfunction in specific, measurable cognitive functions and in the connectivity and synchrony of distributed brain circuits. I overview recent progress in both those domains, and how it may relate to other technologies discussed in companion articles in this issue.

Psychometric validation and clinical correlates of an experiential foraging task

Measuring the function of decision-making systems is a central goal of computational psychiatry. Individual measures of decisional function could be used to describe neurocognitive profiles that underpin psychopathology and offer insights into deficits that are shared across traditional diagnostic classes. However, there are few demonstrably reliable and mechanistically relevant metrics of decision making that can accurately capture the complex overlapping domains of cognition whilst also quantifying the heterogeneity of function between individuals. The WebSurf task is a reverse-translational human experiential foraging paradigm which indexes naturalistic and clinically relevant decision-making. To determine its potential clinical utility, we examined the psychometric properties and clinical correlates of behavioural parameters extracted from WebSurf in an initial exploratory experiment and a pre-registered validation experiment. Behaviour was stable over repeated administrations of the task, as were individual differences. The ability to measure decision making consistently supports the potential utility of the task in predicting an individual's propensity for response to psychiatric treatment, in evaluating clinical change during treatment, and in defining neurocognitive profiles that relate to psychopathology. Specific aspects of WebSurf behaviour also correlate with anhedonic and externalising symptoms. Importantly, these behavioural parameters may measure dimensions of psychological variance that are not captured by traditional rating scales. WebSurf and related paradigms might therefore be useful platforms for computational approaches to precision psychiatry.

State-transition-free reinforcement learning in chimpanzees (Pan troglodytes)

The outcome of an action often occurs after a delay. One solution for learning appropriate actions from delayed outcomes is to rely on a chain of state transitions. Another solution, which does not rest on state transitions, is to use an eligibility trace (ET) that directly bridges a current outcome and multiple past actions via transient memories. Previous studies revealed that humans (Homo sapiens) learned appropriate actions in a behavioral task in which solutions based on the ET were effective but transition-based solutions were ineffective. This suggests that ET may be used in human learning systems. However, no studies have examined nonhuman animals with an equivalent behavioral task. We designed a task for nonhuman animals following a previous human study. In each trial, participants chose one of two stimuli that were randomly selected from three stimulus types: a stimulus associated with a food reward delivered immediately, a stimulus associated with a reward delivered after a few trials, and a stimulus associated with no reward. The presented stimuli did not vary according to the participants' choices. To maximize the total reward, participants had to learn the value of the stimulus associated with a delayed reward. Five chimpanzees (Pan troglodytes) performed the task using a touchscreen. Two chimpanzees were able to learn successfully, indicating that learning mechanisms that do not depend on state transitions were involved in the learning processes. The current study extends previous ET research by proposing a behavioral task and providing empirical data from chimpanzees.

Approach-avoidance reinforcement learning as a translational and computational model of anxiety-related avoidance

Although avoidance is a prevalent feature of anxiety-related psychopathology, differences in the measurement of avoidance between humans and non-human animals hinder our progress in its theoretical understanding and treatment. To address this, we developed a novel translational measure of anxiety-related avoidance in the form of an approach-avoidance reinforcement learning task, by adapting a paradigm from the non-human animal literature to study the same cognitive processes in human participants. We used computational modelling to probe the putative cognitive mechanisms underlying approach-avoidance behaviour in this task and investigated how they relate to subjective task-induced anxiety. In a large online study (n = 372), participants who experienced greater task-induced anxiety avoided choices associated with punishment, even when this resulted in lower overall reward. Computational modelling revealed that this effect was explained by greater individual sensitivities to punishment relative to rewards. We replicated these findings in an independent sample (n = 627) and we also found fair-to-excellent reliability of measures of task performance in a sub-sample retested 1 week later (n = 57). Our findings demonstrate the potential of approach-avoidance reinforcement learning tasks as translational and computational models of anxiety-related avoidance. Future studies should assess the predictive validity of this approach in clinical samples and experimental manipulations of anxiety.

A Multi-task Platform for Profiling Cognitive and Motivational Constructs in Humans and Nonhuman Primates

Background

Understanding the neurobiological substrates of psychiatric disorders requires comprehensive evaluations of cognitive and motivational functions in preclinical research settings. The translational validity of such evaluations will be supported by (1) tasks with high construct validity that are engaging and easy to teach to human and nonhuman participants, (2) software that enables efficient switching between multiple tasks in single sessions, (3) software that supports tasks across a broad range of physical experimental setups, and (4) by platform architectures that are easily extendable and customizable to encourage future optimization and development.

New Method

We describe the Multi-task Universal Suite for Experiments ( M-USE ), a software platform designed to meet these requirements. It leverages the Unity video game engine and C# programming language to (1) support immersive and engaging tasks for humans and nonhuman primates, (2) allow experimenters or participants to switch between multiple tasks within-session, (3) generate builds that function across computers, tablets, and websites, and (4) is freely available online with documentation and tutorials for users and developers. M-USE includes a task library with seven pre-existing tasks assessing cognitive and motivational constructs of perception, attention, working memory, cognitive flexibility, motivational and affective self-control, relational long-term memory, and visuo-spatial problem solving.

Results

M-USE was used to test NHPs on up to six tasks per session, all available as part of the Task Library, and to extract performance metrics for all major cognitive and motivational constructs spanning the Research Domain Criteria (RDoC) of the National Institutes of Mental Health.

Comparison with Existing Methods

Other experiment design and control systems exist, but do not provide the full range of features available in M-USE, including a pre-existing task library for cross-species assessments; the ability to switch seamlessly between tasks in individual sessions; cross-platform build capabilities; license-free availability; and its leveraging of video-engine capabilities used to gamify tasks.

Conclusions

The new multi-task platform facilitates cross-species translational research for understanding the neurobiological substrates of higher cognitive and motivational functions.

Switching to online: Testing the validity of supervised remote testing for online reinforcement learning experiments

Online experiments are an alternative for researchers interested in conducting behavioral research outside the laboratory. However, an online assessment might become a challenge when long and complex experiments need to be conducted in a specific order or with supervision from a researcher. The aim of this study was to test the computational validity and the feasibility of a remote and synchronous reinforcement learning (RL) experiment conducted during the social-distancing measures imposed by the pandemic. An additional feature of this study was to describe how a behavioral experiment originally created to be conducted in-person was transformed into an online supervised remote experiment. Open-source software was used to collect data, conduct statistical analysis, and do computational modeling. Python codes were created to replicate computational models that simulate the effect of working memory (WM) load over RL performance. Our behavioral results indicated that we were able to replicate remotely and with a modified behavioral task the effects of working memory (WM) load over RL performance observed in previous studies with in-person assessments. Our computational analyses using Python code also captured the effects of WM load over RL as expected, which suggests that the algorithms and optimization methods were reliable in their ability to reproduce behavior. The behavioral and computational validation shown in this study and the detailed description of the supervised remote testing may be useful for researchers interested in conducting long and complex experiments online.

Prolonged Physiological Stress Is Associated With a Lower Rate of Exploratory Learning That Is Compounded by Depression

BACKGROUND

Stress is a major risk factor for depression, and both are associated with important changes in decision-making patterns. However, decades of research have only weakly connected physiological measurements of stress to the subjective experience of depression. Here, we examined the relationship between prolonged physiological stress, mood, and explore-exploit decision making in a population navigating a dynamic environment under stress: health care workers during the COVID-19 pandemic.

METHODS

We measured hair cortisol levels in health care workers who completed symptom surveys and performed an explore-exploit restless-bandit decision-making task; 32 participants were included in the final analysis. Hidden Markov and reinforcement learning models assessed task behavior.

RESULTS

Participants with higher hair cortisol exhibited less exploration (r = -0.36, p = .046). Higher cortisol levels predicted less learning during exploration (β = -0.42, false discovery rate [FDR]-corrected p [pFDR] = .022). Importantly, mood did not independently correlate with cortisol concentration, but rather explained additional variance (β = 0.46, pFDR = .022) and strengthened the relationship between higher cortisol and lower levels of exploratory learning (β = -0.47, pFDR = .022) in a joint model. These results were corroborated by a reinforcement learning model, which revealed less learning with higher hair cortisol and low mood (β = -0.67, pFDR = .002).

CONCLUSIONS

These results imply that prolonged physiological stress may limit learning from new information and lead to cognitive rigidity, potentially contributing to burnout. Decision-making measures link subjective mood states to measured physiological stress, suggesting that they should be incorporated into future biomarker studies of mood and stress conditions.

From Computation to Clinic

Theory-driven and data-driven computational approaches to psychiatry have enormous potential for elucidating mechanism of disease and providing translational linkages between basic science findings and the clinic. These approaches have already demonstrated utility in providing clinically relevant understanding, primarily via back translation from clinic to computation, revealing how specific disorders or symptoms map onto specific computational processes. Nonetheless, forward translation, from computation to clinic, remains rare. In addition, consensus regarding specific barriers to forward translation-and on the best strategies to overcome these barriers-is limited. This perspective review brings together expert basic and computationally trained researchers and clinicians to 1) identify challenges specific to preclinical model systems and clinical translation of computational models of cognition and affect, and 2) discuss practical approaches to overcoming these challenges. In doing so, we highlight recent evidence for the ability of computational approaches to predict treatment responses in psychiatric disorders and discuss considerations for maximizing the clinical relevance of such models (e.g., via longitudinal testing) and the likelihood of stakeholder adoption (e.g., via cost-effectiveness analyses).

Pathways to the persistence of drug use despite its adverse consequences

The persistence of drug taking despite its adverse consequences plays a central role in the presentation, diagnosis, and impacts of addiction. Eventual recognition and appraisal of these adverse consequences is central to decisions to reduce or cease use. However, the most appropriate ways of conceptualizing persistence in the face of adverse consequences remain unclear. Here we review evidence that there are at least three pathways to persistent use despite the negative consequences of that use. A cognitive pathway for recognition of adverse consequences, a motivational pathway for valuation of these consequences, and a behavioral pathway for responding to these adverse consequences. These pathways are dynamic, not linear, with multiple possible trajectories between them, and each is sufficient to produce persistence. We describe these pathways, their characteristics, brain cellular and circuit substrates, and we highlight their relevance to different pathways to self- and treatment-guided behavior change.

In silicodevelopment and validation of Bayesian methods for optimizing deep brain stimulation to enhance cognitive control

Objective.deep brain stimulation (DBS) of the ventral internal capsule/striatum (VCVS) is a potentially effective treatment for several mental health disorders when conventional therapeutics fail. Its effectiveness, however, depends on correct programming to engage VCVS sub-circuits. VCVS programming is currently an iterative, time-consuming process, with weeks between setting changes and reliance on noisy, subjective self-reports. An objective measure of circuit engagement might allow individual settings to be tested in seconds to minutes, reducing the time to response and increasing patient and clinician confidence in the chosen settings. Here, we present an approach to measuring and optimizing that circuit engagement.Approach.we leverage prior results showing that effective VCVS DBS engages cognitive control circuitry and improves performance on the multi-source interference task, that this engagement depends primarily on which contact(s) are activated, and that circuit engagement can be tracked through a state space modeling framework. We develop a simulation framework based on those empirical results, then combine this framework with an adaptive optimizer to simulate a principled exploration of electrode contacts and identify the contacts that maximally improve cognitive control. We explore multiple optimization options (algorithms, number of inputs, speed of stimulation parameter changes) and compare them on problems of varying difficulty.Main results.we show that an upper confidence bound algorithm outperforms other optimizers, with roughly 80% probability of convergence to a global optimum when used in a majority-vote ensemble.Significance.we show that the optimization can converge even with lag between stimulation and effect, and that a complete optimization can be done in a clinically feasible timespan (a few hours). Further, the approach requires no specialized recording or imaging hardware, and thus could be a scalable path to expand the use of DBS in psychiatric and other non-motor applications.

Closed-Loop Deep Brain Stimulation for Psychiatric Disorders

ABSTRACT

Deep brain stimulation (DBS) is a well-established approach to treating medication-refractory neurological disorders and holds promise for treating psychiatric disorders. Despite strong open-label results in extremely refractory patients, DBS has struggled to meet endpoints in randomized controlled trials. A major challenge is stimulation "dosing"-DBS systems have many adjustable parameters, and clinicians receive little feedback on whether they have chosen the correct parameters for an individual patient. Multiple groups have proposed closed loop technologies as a solution. These systems sense electrical activity, identify markers of an (un)desired state, then automatically deliver or adjust stimulation to alter that electrical state. Closed loop DBS has been successfully deployed in movement disorders and epilepsy. The availability of that technology, as well as advances in opportunities for invasive research with neurosurgical patients, has yielded multiple pilot demonstrations in psychiatric illness. Those demonstrations split into two schools of thought, one rooted in well-established diagnoses and symptom scales, the other in the more experimental Research Domain Criteria (RDoC) framework. Both are promising, and both are limited by the boundaries of current stimulation technology. They are in turn driving advances in implantable recording hardware, signal processing, and stimulation paradigms. The combination of these advances is likely to change both our understanding of psychiatric neurobiology and our treatment toolbox, though the timeframe may be limited by the realities of implantable device development.

Quantifying aberrant approach-avoidance conflict in psychopathology: A review of computational approaches

Making effective decisions during approach-avoidance conflict is critical in daily life. Aberrant decision-making during approach-avoidance conflict is evident in a range of psychological disorders, including anxiety, depression, trauma-related disorders, substance use disorders, and alcohol use disorders. To help clarify etiological pathways and reveal novel intervention targets, clinical research into decision-making is increasingly adopting a computational psychopathology approach. This approach uses mathematical models that can identify specific decision-making related processes that are altered in mental health disorders. In our review, we highlight foundational approach-avoidance conflict research, followed by more in-depth discussion of computational approaches that have been used to model behavior in these tasks. Specifically, we describe the computational models that have been applied to approach-avoidance conflict (e.g., drift-diffusion, active inference, and reinforcement learning models), and provide resources to guide clinical researchers who may be interested in applying computational modeling. Finally, we identify notable gaps in the current literature and potential future directions for computational approaches aimed at identifying mechanisms of approach-avoidance conflict in psychopathology.

Individual differences in computational psychiatry: a review of current challenges

Bringing precision to the understanding and treatment of mental disorders requires instruments for studying clinically relevant individual differences. One promising approach is the development of computational assays: integrating computational models with cognitive tasks to infer latent patient-specific disease processes in brain computations. While recent years have seen many methodological advancements in computational modelling and many cross-sectional patient studies, much less attention has been paid to basic psychometric properties (reliability and construct validity) of the computational measures provided by the assays. In this review, we assess the extent of this issue by examining emerging empirical evidence. We find that many computational measures suffer from poor psychometric properties, which poses a risk of invalidating previous findings and undermining ongoing research efforts using computational assays to study individual (and even group) differences. We provide recommendations for how to address these problems and, crucially, embed them within a broader perspective on key developments that are needed for translating computational assays to clinical practice.

Causally mapping human threat extinction relevant circuits with depolarizing brain stimulation methods

Laboratory threat extinction paradigms and exposure-based therapy both involve repeated, safe confrontation with stimuli previously experienced as threatening. This fundamental procedural overlap supports laboratory threat extinction as a compelling analogue of exposure-based therapy. Threat extinction impairments have been detected in clinical anxiety and may contribute to exposure-based therapy non-response and relapse. However, efforts to improve exposure outcomes using techniques that boost extinction - primarily rodent extinction - have largely failed to date, potentially due to fundamental differences between rodent and human neurobiology. In this review, we articulate a comprehensive pre-clinical human research agenda designed to overcome these failures. We describe how connectivity guided depolarizing brain stimulation methods (i.e., TMS and DBS) can be applied concurrently with threat extinction and dual threat reconsolidation-extinction paradigms to causally map human extinction relevant circuits and inform the optimal integration of these methods with exposure-based therapy. We highlight candidate targets including the amygdala, hippocampus, ventromedial prefrontal cortex, dorsal anterior cingulate cortex, and mesolimbic structures, and propose hypotheses about how stimulation delivered at specific learning phases could strengthen threat extinction.

Pushing the boundaries of behavioral analysis could aid psychiatric drug discovery

Drug discovery for psychiatric conditions is stagnating. Behavioral changes could be used as a primary phenotypic screen for new drug candidates, if enough useful data can be generated from behavioral models. Could machine learning be the answer to extracting the data we need?

Sunk cost sensitivity during change-of-mind decisions is informed by both the spent and remaining costs

Sunk cost sensitivity describes escalating decision commitment with increased spent resources. On neuroeconomic foraging tasks, mice, rats, and humans show similar escalations from sunk costs while quitting an ongoing countdown to reward. In a new analysis taken across computationally parallel foraging tasks across species and laboratories, we find that these behaviors primarily occur on choices that are economically inconsistent with the subject's other choices, and that they reflect not only the time spent, but also the time remaining, suggesting that these are change-of-mind re-evaluation processes. Using a recently proposed change-of-mind drift-diffusion model, we find that the sunk cost sensitivity in this model arises from decision-processes that directly take into account the time spent (costs sunk). Applying these new insights to experimental data, we find that sensitivity to sunk costs during re-evaluation decisions depends on the information provided to the subject about the time spent and the time remaining.

Distinct forms of regret linked to resilience versus susceptibility to stress are regulated by region-specific CREB function in mice

Regret describes recognizing alternative actions could have led to better outcomes. It remains unclear whether regret derives from generalized mistake appraisal or instead comprises dissociable, action-specific processes. Using a neuroeconomic task, we found that mice were sensitive to fundamentally distinct types of regret following exposure to chronic social defeat stress or manipulations of CREB, a transcription factor implicated in stress action. Bias to make compensatory decisions after rejecting high-value offers (regret type I) was unique to stress-susceptible mice. Bias following the converse operation, accepting low-value offers (regret type II), was enhanced in stress-resilient mice and absent in stress-susceptible mice. CREB function in either the prefrontal cortex or nucleus accumbens was required to suppress regret type I but bidirectionally regulated regret type II. We provide insight into how maladaptive stress response traits relate to distinct forms of counterfactual thinking, which could steer therapy for mood disorders, such as depression, toward circuit-specific computations through a careful description of decision narrative.

Etiopathogenic Models of Psychosis Spectrum Illnesses Must Resolve Four Key Features

Etiopathogenic models for psychosis spectrum illnesses are converging on a number of key processes, such as the influence of specific genes on the synthesis of proteins important in synaptic functioning, alterations in how neurons respond to synaptic inputs and engage in synaptic pruning, and microcircuit dysfunction that leads to more global cortical information processing vulnerabilities. Disruptions in prefrontal operations then accumulate and propagate over time, interacting with environmental factors, developmental processes, and homeostatic mechanisms, eventually resulting in symptoms of psychosis and disability. However, there are 4 key features of psychosis spectrum illnesses that are of primary clinical relevance but have been difficult to assimilate into a single model and have thus far received little direct attention: 1) the bidirectionality of the causal influences for the emergence of psychosis, 2) the catastrophic clinical threshold seen in first episodes of psychosis and why it is irreversible in some individuals, 3) observed biotypes that are neurophysiologically distinct but clinically both convergent and divergent, and 4) a reconciliation of the role of striatal dopaminergic dysfunction with models of prefrontal cortical state instability. In this selective review, we briefly describe these 4 hallmark features and we argue that theoretically driven computational perspectives making use of both algorithmic and neurophysiologic models are needed to reduce this complexity and variability of psychosis spectrum illnesses in a principled manner.

Neuroscience needs evolution

The nervous system is a product of evolution. That is, it was constructed through a long series of modifications, within the strong constraints of heredity, and continuously subjected to intense selection pressures. As a result, the organization and functions of the brain are shaped by its history. We believe that this fact, underappreciated in contemporary systems neuroscience, offers an invaluable aid for helping us resolve the brain's mysteries. Indeed, we think that the consideration of evolutionary history ought to take its place alongside other intellectual tools used to understand the brain, such as behavioural experiments, studies of anatomical structure and functional characterization based on recordings of neural activity. In this introduction, we argue for the importance of evolution by highlighting specific examples of ways that evolutionary theory can enhance neuroscience. The rest of the theme issue elaborates this point, emphasizing the conservative nature of neural evolution, the important consequences of specific transitions that occurred in our history, and the ways in which considerations of evolution can shed light on issues ranging from specific mechanisms to fundamental principles of brain organization.

This article is part of the theme issue ‘Systems neuroscience through the lens of evolutionary theory’.