Computational Psychiatry: From Mechanistic Insights to the Development of New Treatments

Neuroimaging as a Tool for Individualized Treatment Choice in Depression: the Past, the Present and the Future

Purpose of Review

This paper aims to review the findings on neuroimaging as a tool for facilitating individualized treatment choice in depression.

Recent Findings

Neuroimaging has allowed the exploration of neural candidates for response biomarkers. In less than two decades, the field has expanded from small single drug studies to large multisite initiatives testing multiple interventions; from simple analytical methods to employing artificial intelligence, with an aim of establishing models based on a variety of data, such as neuroimaging, biological, psychological and clinical measures.

Summary

Neural biomarkers of response may play an important role in treatment response prediction. It seems likely that they will need to be considered together with other types of data in complex models in order to achieve the high accuracy and generalizability of results necessary for clinical use.

Connectome-based individualized prediction of loneliness

Loneliness is an increasingly prevalent condition linking with enhanced morbidity and premature mortality. Despite recent proposal on medicalization of loneliness, so far no effort has been made to establish a model capable of predicting loneliness at the individual level. Here, we applied a machine-learning approach to decode loneliness from whole-brain resting-state functional connectivity (RSFC). The relationship between whole-brain RSFC and loneliness was examined in a linear predictive model. The results revealed that individual loneliness could be predicted by within- and between-network connectivity of prefrontal, limbic and temporal systems, which are involved in cognitive control, emotional processing and social perceptions and communications, respectively. Key nodes that contributed to the prediction model comprised regions previously implicated in loneliness, including the dorsolateral prefrontal cortex, lateral orbital frontal cortex, ventromedial prefrontal cortex, caudate, amygdala and temporal regions. Our findings also demonstrated that both loneliness and associated neural substrates are modulated by levels of neuroticism and extraversion. The current data-driven approach provides the first evidence on the predictive brain features of loneliness based on organizations of intrinsic brain networks. Our work represents initial efforts in the direction of making individualized prediction of loneliness that could be useful for diagnosis, prognosis and treatment.

Withdrawal from escalated cocaine self-administration impairs reversal learning by disrupting the effects of negative feedback on reward exploitation: a behavioral and computational analysis

Addiction is regarded as a disorder of inflexible choice with behavior dominated by immediate positive rewards over longer-term negative outcomes. However, the psychological mechanisms underlying the effects of self-administered drugs on behavioral flexibility are not well understood. To investigate whether drug exposure causes asymmetric effects on positive and negative outcomes we used a reversal learning procedure to assess how reward contingencies are utilized to guide behavior in rats previously exposed to intravenous cocaine self-administration (SA). Twenty-four rats were screened for anxiety in an open field prior to acquisition of cocaine SA over six daily sessions with subsequent long-access cocaine SA for 7 days. Control rats (n = 24) were trained to lever-press for food under a yoked schedule of reinforcement. Higher rates of cocaine SA were predicted by increased anxiety and preceded impaired reversal learning, expressed by a decrease in lose-shift as opposed to win-stay probability. A model-free reinforcement learning algorithm revealed that rats with high, but not low cocaine escalation failed to exploit previous reward learning and were more likely to repeat the same response as the previous trial. Eight-day withdrawal from high cocaine escalation was associated, respectively, with increased and decreased dopamine receptor D2 (DRD2) and serotonin receptor 2C (HTR2C) expression in the ventral striatum compared with controls. Dopamine receptor D1 (DRD1) expression was also significantly reduced in the orbitofrontal cortex of high cocaine-escalating rats. These findings indicate that withdrawal from escalated cocaine SA disrupts how negative feedback is used to guide goal-directed behavior for natural reinforcers and that trait anxiety may be a latent variable underlying this interaction.

[Computational psychiatry : Data-driven vs. mechanistic approaches]

The emerging research field of so-called computational psychiatry attempts to contribute to an understanding of complex psychiatric phenomena by applying computational methods and to promote the translation of neuroscientific research results into clinical practice. This article presents this field of research using selected examples based on the distinction between data-driven and theory-driven approaches. Exemplary for a data-driven approach are studies to predict clinical outcome, for example, in persons with a high-risk state for psychosis or on the response to pharmacological treatment for depression. Theory-driven approaches attempt to describe the mechanisms of altered information processing as the cause of psychiatric symptoms at the behavioral and neuronal level. In computational models possible mechanisms can be described that may have produced the measured behavioral or neuronal data. For example, in schizophrenia patients the clinical phenomenon of aberrant salience has been described as learning irrelevant information or cognitive deficits have been linked to connectivity changes in frontoparietal networks. Computational psychiatry can make important contributions to the prediction of individual clinical courses as well as to a mechanistic understanding of psychiatric symptoms. For this a further development of reliable and valid methods across different disciplines is indispensable.

The Effect of Reduced Learning Ability on Avoidance in Psychopathy: A Computational Approach

Individuals with psychopathy often show deficits in learning, which often have negative consequences. Several theories have been proposed to explain psychopathic behaviors, but the learning mechanisms in psychopathy are still unclear. To clarify the learning anomalies in psychopathy, we fitted reinforcement learning (RL) models to behavioral data. We conducted two experiments to examine the effect of psychopathy as a group difference (Experiment 1) and as a continuum (Experiment 2). Forty-three undergraduates (in Experiment 1) and fifty-five undergraduate and graduate students (in Experiment 2) performed a go/no-go based learning task with accompanying rewards or punishments. Although we observed no differences in learning performance among the levels of psychopathic traits, the learning rate for the positive prediction error in the loss domain was lower for those with high-psychopathic trait than for those with low-psychopathic trait. This finding indicates that individuals with high-psychopathic traits update an action value less when they avoid a negative outcome. Our model can represent previous theories under a computational framework and provide a new perspective on impaired learning in psychopathy.

Nonsocial and social cognition in schizophrenia: current evidence and future directions

Cognitive impairment in schizophrenia involves a broad array of nonsocial and social cognitive domains. It is a core feature of the illness, and one with substantial implications for treatment and prognosis. Our understanding of the causes, consequences and interventions for cognitive impairment in schizophrenia has grown substantially in recent years. Here we review a range of topics, including: a) the types of nonsocial cognitive, social cognitive, and perceptual deficits in schizophrenia; b) how deficits in schizophrenia are similar or different from those in other disorders; c) cognitive impairments in the prodromal period and over the lifespan in schizophrenia; d) neuroimaging of the neural substrates of nonsocial and social cognition, and e) relationships of nonsocial and social cognition to functional outcome. The paper also reviews the considerable efforts that have been directed to improve cognitive impairments in schizophrenia through novel psychopharmacology, cognitive remediation, social cognitive training, and alternative approaches. In the final section, we consider areas that are emerging and have the potential to provide future insights, including the interface of motivation and cognition, the influence of childhood adversity, metacognition, the role of neuroinflammation, computational modelling, the application of remote digital technology, and novel methods to evaluate brain network organization. The study of cognitive impairment has provided a way to approach, examine and comprehend a wide range of features of schizophrenia, and it may ultimately affect how we define and diagnose this complex disorder.

A Bayesian Account of the Sensory-Motor Interactions Underlying Symptoms of Tourette Syndrome

Tourette syndrome is a hyperkinetic movement disorder. Characteristic features include tics, recurrent movements that are experienced as compulsive and "unwilled"; uncomfortable premonitory sensations that resolve through tic release; and often, the ability to suppress tics temporarily. We demonstrate how these symptoms and features can be understood in terms of aberrant predictive (Bayesian) processing in hierarchical neural systems, explaining specifically: why tics arise, their "unvoluntary" nature, how premonitory sensations emerge, and why tic suppression works-sometimes. In our model, premonitory sensations and tics are generated through over-precise priors for sensation and action within somatomotor regions of the striatum. Abnormally high precision of priors arises through the dysfunctional synaptic integration of cortical inputs. These priors for sensation and action are projected into primary sensory and motor areas, triggering premonitory sensations and tics, which in turn elicit prediction errors for unexpected feelings and movements. We propose experimental paradigms to validate this Bayesian account of tics. Our model integrates behavioural, neuroimaging, and computational approaches to provide mechanistic insight into the pathophysiological basis of Tourette syndrome.

Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling

A well-established notion in cognitive neuroscience proposes that multiple brain systems contribute to choice behaviour. These include: (1) a model-free system that uses values cached from the outcome history of alternative actions, and (2) a model-based system that considers action outcomes and the transition structure of the environment. The widespread use of this distinction, across a range of applications, renders it important to index their distinct influences with high reliability. Here we consider the two-stage task, widely considered as a gold standard measure for the contribution of model-based and model-free systems to human choice. We tested the internal/temporal stability of measures from this task, including those estimated via an established computational model, as well as an extended model using drift-diffusion. Drift-diffusion modeling suggested that both choice in the first stage, and RTs in the second stage, are directly affected by a model-based/free trade-off parameter. Both parameter recovery and the stability of model-based estimates were poor but improved substantially when both choice and RT were used (compared to choice only), and when more trials (than conventionally used in research practice) were included in our analysis. The findings have implications for interpretation of past and future studies based on the use of the two-stage task, as well as for characterising the contribution of model-based processes to choice behaviour.

Roadmap for optimizing the clinical utility of emotional stress paradigms in human neuroimaging research

The emotional stress response is relevant to a number of psychiatric disorders, including posttraumatic stress disorder (PTSD) in particular. Research using neuroimaging methods such as functional magnetic resonance imaging (fMRI) to probe stress-related neural processing have provided some insights into psychiatric disorders. Treatment providers and individual patients would benefit from clinically useful fMRI paradigms that provide information about patients' current brain state and responses to stress in order to inform the treatment selection process. However, neuroimaging has not yet made a meaningful impact on real-world clinical practice. This lack of clinical utility may be related to a number of basic psychometric properties that are often overlooked during fMRI task development. The goals of the current review are to discuss important methodological considerations for current human fMRI stress-related paradigms and to provide a roadmap for developing methodologically sound and clinically useful paradigms. This would include establishing various aspects of reliability, including internal consistency, test-retest and multi-site, as well as validity, including face, content, construct, and criterion. In addition, the establishment of standardized normative data from a large sample of participants would support our understanding of how any one individual compares to the general population. Addressing these methodological gaps will likely have a powerful effect on improving the replicability of findings and optimize our chances for improving real-world clinical outcomes.

Premonitory urges and tics in Tourette syndrome: computational mechanisms and neural correlates

Tourette syndrome is characterized by open motor behaviors - tics - but another crucial aspect of the disorder is the presence of premonitory urges: uncomfortable sensations that typically precede tics and are temporarily alleviated by tics. We review the evidence implicating the somatosensory cortices and the insula in premonitory urges and the motor cortico-basal ganglia-thalamo-cortical loop in tics. We consider how these regions interact during tic execution, suggesting that the insula plays an important role as a nexus linking the sensory and emotional character of premonitory urges with their translation into tics. We also consider how these regions interact during tic learning, integrating the neural evidence with a computational perspective on how premonitory-urge alleviation reinforces tics.

The Stochastic Early Reaction, Inhibition, and late Action (SERIA) model for antisaccades

The antisaccade task is a classic paradigm used to study the voluntary control of eye movements. It requires participants to suppress a reactive eye movement to a visual target and to concurrently initiate a saccade in the opposite direction. Although several models have been proposed to explain error rates and reaction times in this task, no formal model comparison has yet been performed. Here, we describe a Bayesian modeling approach to the antisaccade task that allows us to formally compare different models on the basis of their evidence. First, we provide a formal likelihood function of actions (pro- and antisaccades) and reaction times based on previously published models. Second, we introduce the Stochastic Early Reaction, Inhibition, and late Action model (SERIA), a novel model postulating two different mechanisms that interact in the antisaccade task: an early GO/NO-GO race decision process and a late GO/GO decision process. Third, we apply these models to a data set from an experiment with three mixed blocks of pro- and antisaccade trials. Bayesian model comparison demonstrates that the SERIA model explains the data better than competing models that do not incorporate a late decision process. Moreover, we show that the early decision process postulated by the SERIA model is, to a large extent, insensitive to the cue presented in a single trial. Finally, we use parameter estimates to demonstrate that changes in reaction time and error rate due to the probability of a trial type (pro- or antisaccade) are best explained by faster or slower inhibition and the probability of generating late voluntary prosaccades.