COMPASS: An Open-Source, General-Purpose Software Toolkit for Computational Psychiatry

Closing the loop in psychiatric deep brain stimulation: physiology, psychometrics, and plasticity

Deep brain stimulation (DBS) is an invasive approach to precise modulation of psychiatrically relevant circuits. Although it has impressive results in open-label psychiatric trials, DBS has also struggled to scale to and pass through multi-center randomized trials. This contrasts with Parkinson disease, where DBS is an established therapy treating thousands of patients annually. The core difference between these clinical applications is the difficulty of proving target engagement, and of leveraging the wide range of possible settings (parameters) that can be programmed in a given patient's DBS. In Parkinson's, patients' symptoms change rapidly and visibly when the stimulator is tuned to the correct parameters. In psychiatry, those same changes take days to weeks, limiting a clinician's ability to explore parameter space and identify patient-specific optimal settings. I review new approaches to psychiatric target engagement, with an emphasis on major depressive disorder (MDD). Specifically, I argue that better engagement may come by focusing on the root causes of psychiatric illness: dysfunction in specific, measurable cognitive functions and in the connectivity and synchrony of distributed brain circuits. I overview recent progress in both those domains, and how it may relate to other technologies discussed in companion articles in this issue.

Neural correlates of learning accommodation and consolidation in generalised anxiety disorder

OBJECTIVE.

Anxiety can interfere with attention and working memory, which are components that affect learning. Statistical models have been designed to study learning, such as the Bayesian Learning Model, which takes into account prior possibilities and behaviours to determine how much of a new behaviour is determined by learning instead of chance. However, the neurobiological basis underlying how anxiety interferes with learning is not yet known. Accordingly, we aimed to use neuroimaging techniques and apply a Bayesian Learning Model to study learning in individuals with generalised anxiety disorder (GAD).

METHODS.

Participants were 25 controls and 14 individuals with GAD and comorbid disorders. During fMRI, participants completed a shape-button association learning and reversal task. Using a flexible factorial analysis in SPM, activation in the dorsolateral prefrontal cortex, basal ganglia, and hippocampus was compared between groups during first reversal. Beta values from the peak of these regions were extracted for all learning conditions and submitted to repeated measures analyses in SPSS.

RESULTS.

Individuals with GAD showed less activation in the basal ganglia and the hippocampus only in the first reversal compared with controls. This difference was not present in the initial learning and second reversal.

CONCLUSION.

Given that the basal ganglia is associated with initial learning, and the hippocampus with transfer of knowledge from short- to long-term memory, our results suggest that GAD may engage these regions to a lesser extent during early accommodation or consolidation of learning, but have no longer term effects in brain activation patterns during subsequent learning.

In silicodevelopment and validation of Bayesian methods for optimizing deep brain stimulation to enhance cognitive control

Objective.deep brain stimulation (DBS) of the ventral internal capsule/striatum (VCVS) is a potentially effective treatment for several mental health disorders when conventional therapeutics fail. Its effectiveness, however, depends on correct programming to engage VCVS sub-circuits. VCVS programming is currently an iterative, time-consuming process, with weeks between setting changes and reliance on noisy, subjective self-reports. An objective measure of circuit engagement might allow individual settings to be tested in seconds to minutes, reducing the time to response and increasing patient and clinician confidence in the chosen settings. Here, we present an approach to measuring and optimizing that circuit engagement.Approach.we leverage prior results showing that effective VCVS DBS engages cognitive control circuitry and improves performance on the multi-source interference task, that this engagement depends primarily on which contact(s) are activated, and that circuit engagement can be tracked through a state space modeling framework. We develop a simulation framework based on those empirical results, then combine this framework with an adaptive optimizer to simulate a principled exploration of electrode contacts and identify the contacts that maximally improve cognitive control. We explore multiple optimization options (algorithms, number of inputs, speed of stimulation parameter changes) and compare them on problems of varying difficulty.Main results.we show that an upper confidence bound algorithm outperforms other optimizers, with roughly 80% probability of convergence to a global optimum when used in a majority-vote ensemble.Significance.we show that the optimization can converge even with lag between stimulation and effect, and that a complete optimization can be done in a clinically feasible timespan (a few hours). Further, the approach requires no specialized recording or imaging hardware, and thus could be a scalable path to expand the use of DBS in psychiatric and other non-motor applications.

Closed-Loop Deep Brain Stimulation for Psychiatric Disorders

ABSTRACT

Deep brain stimulation (DBS) is a well-established approach to treating medication-refractory neurological disorders and holds promise for treating psychiatric disorders. Despite strong open-label results in extremely refractory patients, DBS has struggled to meet endpoints in randomized controlled trials. A major challenge is stimulation "dosing"-DBS systems have many adjustable parameters, and clinicians receive little feedback on whether they have chosen the correct parameters for an individual patient. Multiple groups have proposed closed loop technologies as a solution. These systems sense electrical activity, identify markers of an (un)desired state, then automatically deliver or adjust stimulation to alter that electrical state. Closed loop DBS has been successfully deployed in movement disorders and epilepsy. The availability of that technology, as well as advances in opportunities for invasive research with neurosurgical patients, has yielded multiple pilot demonstrations in psychiatric illness. Those demonstrations split into two schools of thought, one rooted in well-established diagnoses and symptom scales, the other in the more experimental Research Domain Criteria (RDoC) framework. Both are promising, and both are limited by the boundaries of current stimulation technology. They are in turn driving advances in implantable recording hardware, signal processing, and stimulation paradigms. The combination of these advances is likely to change both our understanding of psychiatric neurobiology and our treatment toolbox, though the timeframe may be limited by the realities of implantable device development.

Closed-loop enhancement and neural decoding of cognitive control in humans

Deficits in cognitive control-that is, in the ability to withhold a default pre-potent response in favour of a more adaptive choice-are common in depression, anxiety, addiction and other mental disorders. Here we report proof-of-concept evidence that, in participants undergoing intracranial epilepsy monitoring, closed-loop direct stimulation of the internal capsule or striatum, especially the dorsal sites, enhances the participants' cognitive control during a conflict task. We also show that closed-loop stimulation upon the detection of lapses in cognitive control produced larger behavioural changes than open-loop stimulation, and that task performance for single trials can be directly decoded from the activity of a small number of electrodes via neural features that are compatible with existing closed-loop brain implants. Closed-loop enhancement of cognitive control might remediate underlying cognitive deficits and aid the treatment of severe mental disorders.

Microscale multicircuit brain stimulation: Achieving real-time brain state control for novel applications

Neurological and psychiatric disorders typically result from dysfunction across multiple neural circuits. Most of these disorders lack a satisfactory neuromodulation treatment. However, deep brain stimulation (DBS) has been successful in a limited number of disorders; DBS typically targets one or two brain areas with single contacts on relatively large electrodes, allowing for only coarse modulation of circuit function. Because of the dysfunction in distributed neural circuits - each requiring fine, tailored modulation - that characterizes most neuropsychiatric disorders, this approach holds limited promise. To develop the next generation of neuromodulation therapies, we will have to achieve fine-grained, closed-loop control over multiple neural circuits. Recent work has demonstrated spatial and frequency selectivity using microstimulation with many small, closely-spaced contacts, mimicking endogenous neural dynamics. Using custom electrode design and stimulation parameters, it should be possible to achieve bidirectional control over behavioral outcomes, such as increasing or decreasing arousal during central thalamic stimulation. Here, we discuss one possible approach, which we term microscale multicircuit brain stimulation (MMBS). We discuss how machine learning leverages behavioral and neural data to find optimal stimulation parameters across multiple contacts, to drive the brain towards desired states associated with behavioral goals. We expound a mathematical framework for MMBS, where behavioral and neural responses adjust the model in real-time, allowing us to adjust stimulation in real-time. These technologies will be critical to the development of the next generation of neurostimulation therapies, which will allow us to treat problems like disorders of consciousness and cognition.

Neural Basis of Associative Learning in Trichotillomania and Skin-Picking Disorder

Disorders such as Trichotillomania (TTM) and skin-picking disorder (SPD) are associated with reduced flexibility and increased internally focused attention. While the basal ganglia have been hypothesized to play a key role, the mechanisms underlying learning and flexible accommodation of new information is unclear. Using a Bayesian Learning Model, we evaluated the neural basis of learning and accommodation in individuals with TTM and/or SPD. Participants were 127 individuals with TTM and/or SPD (TTM/SPD) recruited from three sites (age 18-57, 84% female) and 26 healthy controls (HC). During fMRI, participants completed a shape-button associative learning and reversal fMRI task. Above-threshold clusters were identified where the Initial Learning-Reversals BOLD activation contrast differed significantly (p < .05 FDR-corrected) between the two groups. A priori, effects were anticipated in predefined ROIs in bilateral basal ganglia, with exploratory analyses in the hippocampus, dorsolateral prefrontal cortex (dlPFC), and dorsal anterior cingulate cortex (dACC). Relative to HC, individuals with TTM/SPD demonstrated reduced activation during initial learning compared to reversal learning in the right basal ganglia. Similarly, individuals with TTM/SPD demonstrated reduced activation during initial learning compared to reversal learning in several clusters in the dlPFC and dACC compared to HC. Individuals with TTM/SPD may form or reform visual stimulus-motor response associations through different brain mechanisms than healthy controls. The former exhibit altered activation within the basal ganglia, dlPFC, and dACC during an associative learning task compared to controls, reflecting reduced frontal-subcortical activation during initial learning. Future work should determine whether these neural deficits may be restored with targeted treatment.

TAPAS: An Open-Source Software Package for Translational Neuromodeling and Computational Psychiatry

Psychiatry faces fundamental challenges with regard to mechanistically guided differential diagnosis, as well as prediction of clinical trajectories and treatment response of individual patients. This has motivated the genesis of two closely intertwined fields: (i) Translational Neuromodeling (TN), which develops "computational assays" for inferring patient-specific disease processes from neuroimaging, electrophysiological, and behavioral data; and (ii) Computational Psychiatry (CP), with the goal of incorporating computational assays into clinical decision making in everyday practice. In order to serve as objective and reliable tools for clinical routine, computational assays require end-to-end pipelines from raw data (input) to clinically useful information (output). While these are yet to be established in clinical practice, individual components of this general end-to-end pipeline are being developed and made openly available for community use. In this paper, we present the Translational Algorithms for Psychiatry-Advancing Science (TAPAS) software package, an open-source collection of building blocks for computational assays in psychiatry. Collectively, the tools in TAPAS presently cover several important aspects of the desired end-to-end pipeline, including: (i) tailored experimental designs and optimization of measurement strategy prior to data acquisition, (ii) quality control during data acquisition, and (iii) artifact correction, statistical inference, and clinical application after data acquisition. Here, we review the different tools within TAPAS and illustrate how these may help provide a deeper understanding of neural and cognitive mechanisms of disease, with the ultimate goal of establishing automatized pipelines for predictions about individual patients. We hope that the openly available tools in TAPAS will contribute to the further development of TN/CP and facilitate the translation of advances in computational neuroscience into clinically relevant computational assays.

Deep brain stimulation for psychiatric disorders: From focal brain targets to cognitive networks

Deep brain stimulation (DBS) is a promising intervention for treatment-resistant psychiatric disorders, particularly major depressive disorder (MDD) and obsessive-compulsive disorder (OCD). Up to 90% of patients who have not recovered with therapy or medication have reported benefit from DBS in open-label studies. Response rates in randomized controlled trials (RCTs), however, have been much lower. This has been argued to arise from surgical variability between sites, and recent psychiatric DBS research has focused on refining targeting through personalized imaging. Much less attention has been given to the fact that psychiatric disorders arise from dysfunction in distributed brain networks, and that DBS likely acts by altering communication within those networks. This is in part because psychiatric DBS research relies on subjective rating scales that make it difficult to identify network biomarkers. Here, we overview recent DBS RCT results in OCD and MDD, as well as the follow-on imaging studies. We present evidence for a new approach to studying DBS' mechanisms of action, focused on measuring objective cognitive/emotional deficits that underpin these and many other mental disorders. Further, we suggest that a focus on cognition could lead to reliable network biomarkers at an electrophysiologic level, especially those related to inter-regional synchrony of the local field potential (LFP). Developing the network neuroscience of DBS has the potential to finally unlock the potential of this highly specific therapy.

CLoSES: A platform for closed-loop intracranial stimulation in humans

Targeted interrogation of brain networks through invasive brain stimulation has become an increasingly important research tool as well as therapeutic modality. The majority of work with this emerging capability has been focused on open-loop approaches. Closed-loop techniques, however, could improve neuromodulatory therapies and research investigations by optimizing stimulation approaches using neurally informed, personalized targets. Implementing closed-loop systems is challenging particularly with regard to applying consistent strategies considering inter-individual variability. In particular, during intracranial epilepsy monitoring, where much of this research is currently progressing, electrodes are implanted exclusively for clinical reasons. Thus, detection and stimulation sites must be participant- and task-specific. The system must run in parallel with clinical systems, integrate seamlessly with existing setups, and ensure safety features are in place. In other words, a robust, yet flexible platform is required to perform different tests with a single participant and to comply with clinical requirements. In order to investigate closed-loop stimulation for research and therapeutic use, we developed a Closed-Loop System for Electrical Stimulation (CLoSES) that computes neural features which are then used in a decision algorithm to trigger stimulation in near real-time. To summarize CLoSES, intracranial electroencephalography (iEEG) signals are acquired, band-pass filtered, and local and network features are continuously computed. If target features are detected (e.g. above a preset threshold for a certain duration), stimulation is triggered. Not only could the system trigger stimulation while detecting real-time neural features, but we incorporated a pipeline wherein we used an encoder/decoder model to estimate a hidden cognitive state from the neural features. CLoSES provides a flexible platform to implement a variety of closed-loop experimental paradigms in humans. CLoSES has been successfully used with twelve patients implanted with depth electrodes in the epilepsy monitoring unit. During cognitive tasks (N=5), stimulation in closed loop modified a cognitive hidden state on a trial by trial basis. Sleep spindle oscillations (N=6) and sharp transient epileptic activity (N=9) were detected in near real-time, and stimulation was applied during the event or at specified delays (N=3). In addition, we measured the capabilities of the CLoSES system. Total latency was related to the characteristics of the event being detected, with tens of milliseconds for epileptic activity and hundreds of milliseconds for spindle detection. Stepwise latency, the actual duration of each continuous step, was within the specified fixed-step duration and increased linearly with the number of channels and features. We anticipate that probing neural dynamics and interaction between brain states and stimulation responses with CLoSES will lead to novel insights into the mechanism of normal and pathological brain activity, the discovery and evaluation of potential electrographic biomarkers of neurological and psychiatric disorders, and the development and testing of patient-specific stimulation targets and control signals before implanting a therapeutic device.

Decoding task engagement from distributed network electrophysiology in humans

OBJECTIVE

Here, our objective was to develop a binary decoder to detect task engagement in humans during two distinct, conflict-based behavioral tasks. Effortful, goal-directed decision-making requires the coordinated action of multiple cognitive processes, including attention, working memory and action selection. That type of mental effort is often dysfunctional in mental disorders, e.g. when a patient attempts to overcome a depression or anxiety-driven habit but feels unable. If the onset of engagement in this type of focused mental activity could be reliably detected, decisional function might be augmented, e.g. through neurostimulation. However, there are no known algorithms for detecting task engagement with rapid time resolution.

APPROACH

We defined a new network measure, fixed canonical correlation (FCCA), specifically suited for neural decoding applications. We extracted FCCA features from local field potential recordings in human volunteers to give a temporally continuous estimate of mental effort, defined by engagement in experimental conflict tasks.

MAIN RESULTS

Using a small number of features per participant, we accurately decoded and distinguished task engagement from other mental activities. Further, the decoder distinguished between engagement in two different conflict-based tasks within seconds of their onset.

SIGNIFICANCE

These results demonstrate that network-level brain activity can detect specific types of mental efforts. This could form the basis of a responsive intervention strategy for decision-making deficits.

Deep brain stimulation of the internal capsule enhances human cognitive control and prefrontal cortex function

Deep brain stimulation (DBS) is a circuit-oriented treatment for mental disorders. Unfortunately, even well-conducted psychiatric DBS clinical trials have yielded inconsistent symptom relief, in part because DBS’ mechanism(s) of action are unclear. One clue to those mechanisms may lie in the efficacy of ventral internal capsule/ventral striatum (VCVS) DBS in both major depression (MDD) and obsessive-compulsive disorder (OCD). MDD and OCD both involve deficits in cognitive control. Cognitive control depends on prefrontal cortex (PFC) regions that project into the VCVS. Here, we show that VCVS DBS’ effect is explained in part by enhancement of PFC-driven cognitive control. DBS improves human subjects’ performance on a cognitive control task and increases theta (5–8Hz) oscillations in both medial and lateral PFC. The theta increase predicts subjects’ clinical outcomes. Our results suggest a possible mechanistic approach to DBS therapy, based on tuning stimulation to optimize these neurophysiologic phenomena.

Deep brain stimulation (DBS) is a promising treatment for psychiatric disorders, but its mechanism in relieving symptoms is unclear. Here, the authors show that DBS of ventral internal capsule/ventral striatum (VCVS) may act by enhancing prefrontal cortex oscillations that in turn enhance cognitive control.