1
|
McInnes AN, Olsen ST, Sullivan CR, Cooper DC, Wilson S, Sonmez AI, Albott CS, Olson SC, Peterson CB, Rittberg BR, Herman A, Bajzer M, Nahas Z, Widge AS. Trajectory Modeling and Response Prediction in Transcranial Magnetic Stimulation for Depression. PERSONALIZED MEDICINE IN PSYCHIATRY 2024; 47-48:100135. [PMID: 39257484 PMCID: PMC11382337 DOI: 10.1016/j.pmip.2024.100135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/12/2024]
Abstract
Background Repetitive transcranial magnetic stimulation (rTMS) therapy could be improved by more accurate and earlier prediction of response. Latent class mixture (LCMM) and non-linear mixed effects (NLME) modeling have been applied to model the trajectories of antidepressant response (or non-response) to TMS, but it is not known whether such models are useful in predicting clinically meaningful change in symptom severity, i.e. categorical (non)response as opposed to continuous scores. Methods We compared LCMM and NLME approaches to model the antidepressant response to TMS in a naturalistic sample of 238 patients receiving rTMS for treatment resistant depression, across multiple coils and protocols. We then compared the predictive power of those models. Results LCMM trajectories were influenced largely by baseline symptom severity, but baseline symptoms provided little predictive power for later antidepressant response. Rather, the optimal LCMM model was a nonlinear two-class model that accounted for baseline symptoms. This model accurately predicted patient response at 4 weeks of treatment (AUC = 0.70, 95% CI = [0.52 - 0.87]), but not before. NLME offered slightly improved predictive performance at 4 weeks of treatment (AUC = 0.76, 95% CI = [0.58 - 0.94], but likewise, not before. Conclusions In showing the predictive validity of these approaches to model response trajectories to rTMS, we provided preliminary evidence that trajectory modeling could be used to guide future treatment decisions.
Collapse
Affiliation(s)
- Aaron N. McInnes
- Corresponding authors: Aaron N. McInnes PhD and Alik S. Widge MD, PhD, Department of Psychiatry, University of Minnesota, Twin Cities, McGuire Translational Research Facility, 2001 6th St SE, Minneapolis, MN 55455,
| | | | - Christi R.P. Sullivan
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Dawson C. Cooper
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Saydra Wilson
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Ayse Irem Sonmez
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - C. Sophia Albott
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Stephen C. Olson
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Carol B. Peterson
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Barry R. Rittberg
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Alexander Herman
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Matej Bajzer
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Ziad Nahas
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Alik S. Widge
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| |
Collapse
|
2
|
Sani OG, Pesaran B, Shanechi MM. Dissociative and prioritized modeling of behaviorally relevant neural dynamics using recurrent neural networks. Nat Neurosci 2024; 27:2033-2045. [PMID: 39242944 PMCID: PMC11452342 DOI: 10.1038/s41593-024-01731-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2023] [Accepted: 07/17/2024] [Indexed: 09/09/2024]
Abstract
Understanding the dynamical transformation of neural activity to behavior requires new capabilities to nonlinearly model, dissociate and prioritize behaviorally relevant neural dynamics and test hypotheses about the origin of nonlinearity. We present dissociative prioritized analysis of dynamics (DPAD), a nonlinear dynamical modeling approach that enables these capabilities with a multisection neural network architecture and training approach. Analyzing cortical spiking and local field potential activity across four movement tasks, we demonstrate five use-cases. DPAD enabled more accurate neural-behavioral prediction. It identified nonlinear dynamical transformations of local field potentials that were more behavior predictive than traditional power features. Further, DPAD achieved behavior-predictive nonlinear neural dimensionality reduction. It enabled hypothesis testing regarding nonlinearities in neural-behavioral transformation, revealing that, in our datasets, nonlinearities could largely be isolated to the mapping from latent cortical dynamics to behavior. Finally, DPAD extended across continuous, intermittently sampled and categorical behaviors. DPAD provides a powerful tool for nonlinear dynamical modeling and investigation of neural-behavioral data.
Collapse
Affiliation(s)
- Omid G Sani
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA
| | - Bijan Pesaran
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Maryam M Shanechi
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA.
- Thomas Lord Department of Computer Science, University of Southern California, Los Angeles, CA, USA.
- Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, USA.
- Alfred E. Mann Department of Biomedical Engineering, University of Southern California, Los Angeles, CA, USA.
| |
Collapse
|
3
|
Racicot J, Smine S, Afzali K, Orban P. Functional brain connectivity changes associated with day-to-day fluctuations in affective states. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2024:10.3758/s13415-024-01216-6. [PMID: 39322824 DOI: 10.3758/s13415-024-01216-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 08/15/2024] [Indexed: 09/27/2024]
Abstract
Affective neuroscience has traditionally relied on cross-sectional studies to uncover the brain correlates of affects, emotions, and moods. Such findings obfuscate intraindividual variability that may reveal meaningful changing affect states. The few functional magnetic resonance imaging longitudinal studies that have linked changes in brain function to the ebbs and flows of affective states over time have mostly investigated a single individual. In this study, we explored how the functional connectivity of brain areas associated with affective processes can explain within-person fluctuations in self-reported positive and negative affects across several subjects. To do so, we leveraged the Day2day dataset that includes 40 to 50 resting-state functional magnetic resonance imaging scans along self-reported positive and negative affectivity from a sample of six healthy participants. Sparse multivariate mixed-effect linear models could explain 15% and 11% of the within-person variation in positive and negative affective states, respectively. Evaluation of these models' generalizability to new data demonstrated the ability to predict approximately 5% and 2% of positive and negative affect variation. The functional connectivity of limbic areas, such as the amygdala, hippocampus, and insula, appeared most important to explain the temporal dynamics of affects over days, weeks, and months.
Collapse
Affiliation(s)
- Jeanne Racicot
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Montréal, Montréal, Canada
- Département de Psychiatrie et d'addictologie, Université de Montréal, Montréal, Canada
| | - Salima Smine
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Montréal, Montréal, Canada
| | - Kamran Afzali
- Consortium Santé Numérique, Université de Montréal, Montréal, Canada
| | - Pierre Orban
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Montréal, Montréal, Canada.
- Département de Psychiatrie et d'addictologie, Université de Montréal, Montréal, Canada.
| |
Collapse
|
4
|
Huang Y, Yao K, Zhang Q, Huang X, Chen Z, Zhou Y, Yu X. Bioelectronics for electrical stimulation: materials, devices and biomedical applications. Chem Soc Rev 2024; 53:8632-8712. [PMID: 39132912 DOI: 10.1039/d4cs00413b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/13/2024]
Abstract
Bioelectronics is a hot research topic, yet an important tool, as it facilitates the creation of advanced medical devices that interact with biological systems to effectively diagnose, monitor and treat a broad spectrum of health conditions. Electrical stimulation (ES) is a pivotal technique in bioelectronics, offering a precise, non-pharmacological means to modulate and control biological processes across molecular, cellular, tissue, and organ levels. This method holds the potential to restore or enhance physiological functions compromised by diseases or injuries by integrating sophisticated electrical signals, device interfaces, and designs tailored to specific biological mechanisms. This review explains the mechanisms by which ES influences cellular behaviors, introduces the essential stimulation principles, discusses the performance requirements for optimal ES systems, and highlights the representative applications. From this review, we can realize the potential of ES based bioelectronics in therapy, regenerative medicine and rehabilitation engineering technologies, ranging from tissue engineering to neurological technologies, and the modulation of cardiovascular and cognitive functions. This review underscores the versatility of ES in various biomedical contexts and emphasizes the need to adapt to complex biological and clinical landscapes it addresses.
Collapse
Affiliation(s)
- Ya Huang
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Kuanming Yao
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Qiang Zhang
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Xingcan Huang
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Zhenlin Chen
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Yu Zhou
- Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong, China.
| | - Xinge Yu
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| |
Collapse
|
5
|
Myers J, Xiao J, Mathura R, Shofty B, Pirtle V, Adkinson J, Allawala AB, Anand A, Gadot R, Najera R, Rey HG, Mathew SJ, Bijanki K, Banks G, Watrous A, Bartoli E, Heilbronner SR, Provenza N, Goodman WK, Pouratian N, Hayden BY, Sheth SA. Intracranial Directed Connectivity Links Subregions of the Prefrontal Cortex to Major Depression. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.08.07.24311546. [PMID: 39148826 PMCID: PMC11326344 DOI: 10.1101/2024.08.07.24311546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 08/17/2024]
Abstract
Understanding the neural basis of major depressive disorder (MDD) is vital to guiding neuromodulatory treatments. The available evidence supports the hypothesis that MDD is fundamentally a disease of cortical disinhibition, where breakdowns of inhibitory neural systems lead to diminished emotion regulation and intrusive ruminations. Recent research also points towards network changes in the brain, especially within the prefrontal cortex (PFC), as primary sources of MDD etiology. However, due to limitations in spatiotemporal resolution and clinical opportunities for intracranial recordings, this hypothesis has not been directly tested. We recorded intracranial EEG from the dorsolateral (dlPFC), orbitofrontal (OFC), and anterior cingulate cortices (ACC) in neurosurgical patients with MDD. We measured daily fluctuations in self-reported depression severity alongside directed connectivity between these PFC subregions. We focused primarily on delta oscillations (1-3 Hz), which have been linked to GABAergic inhibitory control and intracortical communication. Depression symptoms worsened when connectivity within the left vs. right PFC became imbalanced. In the left hemisphere, all directed connectivity towards the ACC, from the dlPFC and OFC, was positively correlated with depression severity. In the right hemisphere, directed connectivity between the OFC and dlPFC increased with depression severity as well. This is the first evidence that delta oscillations flowing between prefrontal subregions transiently increase intensity when people are experiencing more negative mood. These findings support the overarching hypothesis that MDD worsens with prefrontal disinhibition.
Collapse
Affiliation(s)
- John Myers
- Baylor College of Medicine, Department of Neurosurgery
| | - Jiayang Xiao
- Baylor College of Medicine, Department of Neurosurgery
| | | | - Ben Shofty
- Baylor College of Medicine, Department of Neurosurgery
| | | | | | | | - Adrish Anand
- Baylor College of Medicine, Department of Neurosurgery
| | - Ron Gadot
- Baylor College of Medicine, Department of Neurosurgery
| | | | - Hernan G. Rey
- Baylor College of Medicine, Department of Neurosurgery
| | - Sanjay J. Mathew
- Baylor College of Medicine, Department of Psychiatry and Behavioral Science
| | - Kelly Bijanki
- Baylor College of Medicine, Department of Neurosurgery
| | - Garrett Banks
- Baylor College of Medicine, Department of Neurosurgery
| | | | | | | | | | - Wayne K. Goodman
- University of Texas: Southwestern, Department of Neurological Surgery
| | - Nader Pouratian
- University of Texas: Southwestern, Department of Neurological Surgery
| | | | | |
Collapse
|
6
|
Denfield GH, Kyzar EJ. The Nested States Model: A Phenomenologically-Grounded Model of the Mind. Psychopathology 2024:1-15. [PMID: 39084192 DOI: 10.1159/000540319] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Accepted: 07/08/2024] [Indexed: 08/02/2024]
Abstract
BACKGROUND Subjective experience is central to the nature of mental illness, yet it has not played a central role in most empirical approaches to psychopathology. While phenomenological perspectives in psychiatry have seen a recent resurgence, there remains a need for more detailed models of psychopathological processes based on explicit phenomenological and enactive foundations. SUMMARY We present a framework derived from the Nested States Model (NSM) through which such phenomenologically-grounded models might be constructed. The NSM describes the dynamic structure of subjective experience as a system of nested states that reciprocally influence one another across hierarchical layers. Here, we show how the NSM provides a scheme for characterizing patterns of experience that comprise various psychopathological processes. We demonstrate the utility of this scheme both for clinical practice and for building our knowledge of psychopathological processes more broadly. KEY MESSAGES The NSM can advance three aims that we see as critical for the lasting integration of phenomenological approaches to psychopathology within psychiatry. First, we show that the NSM provides a means for constructing clinical formulations and treatment considerations that center squarely on an individual's subjective experiences. Second, the NSM supplies a framework for organizing findings from clinical-phenomenological research that can guide the construction of broader phenomenologically-grounded models of psychopathological processes. Lastly, the NSM aligns our perspective on subjective experience with emerging perspectives on brain dynamics, helping to bridge phenomenological work with ongoing neurophysiological research.
Collapse
Affiliation(s)
- George H Denfield
- Department of Psychiatry, Columbia University, New York, New York, USA
- New York State Psychiatric Institute, New York, New York, USA
- Creedmoor Psychiatric Center, Queens, New York, USA
| | - Evan J Kyzar
- Department of Psychiatry, Columbia University, New York, New York, USA
- New York State Psychiatric Institute, New York, New York, USA
| |
Collapse
|
7
|
Wang C, Sun Y, Xing Y, Liu K, Xu K. Role of electrophysiological activity and interactions of lateral habenula in the development of depression-like behavior in a chronic restraint stress model. Brain Res 2024; 1835:148914. [PMID: 38580047 DOI: 10.1016/j.brainres.2024.148914] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Revised: 02/20/2024] [Accepted: 04/02/2024] [Indexed: 04/07/2024]
Abstract
Closed-loop deep brain stimulation (DBS) system offers a promising approach for treatment-resistant depression, but identifying universally accepted electrophysiological biomarkers for closed-loop DBS systems targeting depression is challenging. There is growing evidence suggesting a strong association between the lateral habenula (LHb) and depression. Here, we took LHb as a key target, utilizing multi-site local field potentials (LFPs) to study the acute and chronic changes in electrophysiology, functional connectivity, and brain network characteristics during the formation of a chronic restraint stress (CRS) model. Furthermore, our model combining the electrophysiological changes of LHb and interactions between LHb and other potential targets of depression can effectively distinguish depressive states, offering a new way for developing effective closed-loop DBS strategies.
Collapse
Affiliation(s)
- Chang Wang
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, China; Nanhu Brain-computer Interface Institute, Hangzhou 311100,China; Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Key Laboratory of Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou, China; State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou, China.
| | - Yuting Sun
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, China; Nanhu Brain-computer Interface Institute, Hangzhou 311100,China; Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Key Laboratory of Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou, China; State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou, China.
| | - Yanjie Xing
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, China; Nanhu Brain-computer Interface Institute, Hangzhou 311100,China; Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Key Laboratory of Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou, China; State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou, China.
| | - Kezhou Liu
- School of Automation (Artificial Intelligence), Hangzhou Dianzi University, Hangzhou 310018, China.
| | - Kedi Xu
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, China; Nanhu Brain-computer Interface Institute, Hangzhou 311100,China; Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Key Laboratory of Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou, China; State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou, China.
| |
Collapse
|
8
|
Liu J, Younk R, Drahos LM, Nagrale SS, Yadav S, Widge AS, Shoaran M. Neural Decoding and Feature Selection Techniques for Closed-Loop Control of Defensive Behavior. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.06.06.597165. [PMID: 38895388 PMCID: PMC11185693 DOI: 10.1101/2024.06.06.597165] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
Objective Many psychiatric disorders involve excessive avoidant or defensive behavior, such as avoidance in anxiety and trauma disorders or defensive rituals in obsessive-compulsive disorders. Developing algorithms to predict these behaviors from local field potentials (LFPs) could serve as foundational technology for closed-loop control of such disorders. A significant challenge is identifying the LFP features that encode these defensive behaviors. Approach We analyzed LFP signals from the infralimbic cortex and basolateral amygdala of rats undergoing tone-shock conditioning and extinction, standard for investigating defensive behaviors. We utilized a comprehensive set of neuro-markers across spectral, temporal, and connectivity domains, employing SHapley Additive exPlanations for feature importance evaluation within Light Gradient-Boosting Machine models. Our goal was to decode three commonly studied avoidance/defensive behaviors: freezing, bar-press suppression, and motion (accelerometry), examining the impact of different features on decoding performance. Main results Band power and band power ratio between channels emerged as optimal features across sessions. High-gamma (80-150 Hz) power, power ratios, and inter-regional correlations were more informative than other bands that are more classically linked to defensive behaviors. Focusing on highly informative features enhanced performance. Across 4 recording sessions with 16 subjects, we achieved an average coefficient of determination of 0.5357 and 0.3476, and Pearson correlation coefficients of 0.7579 and 0.6092 for accelerometry jerk and bar press rate, respectively. Utilizing only the most informative features revealed differential encoding between accelerometry and bar press rate, with the former primarily through local spectral power and the latter via inter-regional connectivity. Our methodology demonstrated remarkably low time complexity, requiring <110 ms for training and <1 ms for inference. Significance Our results demonstrate the feasibility of accurately decoding defensive behaviors with minimal latency, using LFP features from neural circuits strongly linked to these behaviors. This methodology holds promise for real-time decoding to identify physiological targets in closed-loop psychiatric neuromodulation.
Collapse
Affiliation(s)
- Jinhan Liu
- Institute of Electrical and Micro Engineering, EPFL, Lausanne, Switzerland
- Neuro-X Institute, EPFL, Geneva, Switzerland
| | - Rebecca Younk
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| | - Lauren M Drahos
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| | - Sumedh S Nagrale
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| | - Shreya Yadav
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| | - Alik S Widge
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
- These authors jointly supervised this work
| | - Mahsa Shoaran
- Institute of Electrical and Micro Engineering, EPFL, Lausanne, Switzerland
- Neuro-X Institute, EPFL, Geneva, Switzerland
- These authors jointly supervised this work
| |
Collapse
|
9
|
Fang H, Berman SA, Wang Y, Yang Y. Robust adaptive deep brain stimulation control of in-silico non-stationary Parkinsonian neural oscillatory dynamics. J Neural Eng 2024; 21:036043. [PMID: 38834058 DOI: 10.1088/1741-2552/ad5406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Accepted: 06/04/2024] [Indexed: 06/06/2024]
Abstract
Objective. Closed-loop deep brain stimulation (DBS) is a promising therapy for Parkinson's disease (PD) that works by adjusting DBS patterns in real time from the guidance of feedback neural activity. Current closed-loop DBS mainly uses threshold-crossing on-off controllers or linear time-invariant (LTI) controllers to regulate the basal ganglia (BG) Parkinsonian beta band oscillation power. However, the critical cortex-BG-thalamus network dynamics underlying PD are nonlinear, non-stationary, and noisy, hindering accurate and robust control of Parkinsonian neural oscillatory dynamics.Approach. Here, we develop a new robust adaptive closed-loop DBS method for regulating the Parkinsonian beta oscillatory dynamics of the cortex-BG-thalamus network. We first build an adaptive state-space model to quantify the dynamic, nonlinear, and non-stationary neural activity. We then construct an adaptive estimator to track the nonlinearity and non-stationarity in real time. We next design a robust controller to automatically determine the DBS frequency based on the estimated Parkinsonian neural state while reducing the system's sensitivity to high-frequency noise. We adopt and tune a biophysical cortex-BG-thalamus network model as an in-silico simulation testbed to generate nonlinear and non-stationary Parkinsonian neural dynamics for evaluating DBS methods.Main results. We find that under different nonlinear and non-stationary neural dynamics, our robust adaptive DBS method achieved accurate regulation of the BG Parkinsonian beta band oscillation power with small control error, bias, and deviation. Moreover, the accurate regulation generalizes across different therapeutic targets and consistently outperforms current on-off and LTI DBS methods.Significance. These results have implications for future designs of closed-loop DBS systems to treat PD.
Collapse
Affiliation(s)
- Hao Fang
- MOE Frontier Science Center for Brain Science and Brain-machine Integration, Zhejiang University, Hangzhou 310058, People's Republic of China
- Nanhu Brain-computer Interface Institute, Hangzhou 311100, People's Republic of China
| | - Stephen A Berman
- College of Medicine, University of Central Florida, Orlando, FL 32816, United States of America
| | - Yueming Wang
- Nanhu Brain-computer Interface Institute, Hangzhou 311100, People's Republic of China
- Qiushi Academy for Advanced Studies, Hangzhou 310058, People's Republic of China
- College of Computer Science and Technology, Zhejiang University, Hangzhou 310058, People's Republic of China
- State Key Laboratory of Brain-machine Intelligence, Hangzhou 310058, People's Republic of China
| | - Yuxiao Yang
- MOE Frontier Science Center for Brain Science and Brain-machine Integration, Zhejiang University, Hangzhou 310058, People's Republic of China
- Nanhu Brain-computer Interface Institute, Hangzhou 311100, People's Republic of China
- College of Computer Science and Technology, Zhejiang University, Hangzhou 310058, People's Republic of China
- State Key Laboratory of Brain-machine Intelligence, Hangzhou 310058, People's Republic of China
- Department of Neurosurgery, Second Affiliated Hospital, School of Medicine, Hangzhou 310058, People's Republic of China
- NHC and CAMS Key Laboratory of Medical Neurobiology, Zhejiang University, Hangzhou 310058, People's Republic of China
| |
Collapse
|
10
|
McInnes AN, Olsen ST, Sullivan CR, Cooper DC, Wilson S, Sonmez AI, Albott SC, Olson SC, Peterson CB, Rittberg BR, Herman A, Bajzer M, Nahas Z, Widge AS. Trajectory Modeling and Response Prediction in Transcranial Magnetic Stimulation for Depression. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.05.30.24308258. [PMID: 38853937 PMCID: PMC11160841 DOI: 10.1101/2024.05.30.24308258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2024]
Abstract
Repetitive transcranial magnetic stimulation (rTMS) therapy could be improved by better and earlier prediction of response. Latent class mixture (LCMM) and non-linear mixed effects (NLME) modelling have been applied to model the trajectories of antidepressant response (or non-response) to TMS, but it is not known whether such models can predict clinical outcomes. We compared LCMM and NLME approaches to model the antidepressant response to TMS in a naturalistic sample of 238 patients receiving rTMS for treatment resistant depression (TRD), across multiple coils and protocols. We then compared the predictive power of those models. LCMM trajectories were influenced largely by baseline symptom severity, but baseline symptoms provided little predictive power for later antidepressant response. Rather, the optimal LCMM model was a nonlinear two-class model that accounted for baseline symptoms. This model accurately predicted patient response at 4 weeks of treatment (AUC = 0.70, 95% CI = [0.52-0.87]), but not before. NLME offered slightly improved predictive performance at 4 weeks of treatment (AUC = 0.76, 95% CI = [0.58 - 0.94], but likewise, not before. In showing the predictive validity of these approaches to model response trajectories to rTMS, we provided preliminary evidence that trajectory modeling could be used to guide future treatment decisions.
Collapse
Affiliation(s)
- Aaron N. McInnes
- Corresponding authors: Aaron N. McInnes PhD and Alik S. Widge MD, PhD, Department of Psychiatry, University of Minnesota, Twin Cities, McGuire Translational Research Facility, 2001 6th St SE, Minneapolis, MN 55455,
| | | | - Christi R.P. Sullivan
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Dawson C. Cooper
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Saydra Wilson
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Ayse Irem Sonmez
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Sophia C. Albott
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Stephen C. Olson
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Carol B. Peterson
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Barry R. Rittberg
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Alexander Herman
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Matej Bajzer
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Ziad Nahas
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| | - Alik S. Widge
- Department of Psychiatry and Behavioral Science, University of Minnesota Twin Cities, Minneapolis, MN, USA
| |
Collapse
|
11
|
Alasfour A, Gilja V. Consistent spectro-spatial features of human ECoG successfully decode naturalistic behavioral states. Front Hum Neurosci 2024; 18:1388267. [PMID: 38873653 PMCID: PMC11169785 DOI: 10.3389/fnhum.2024.1388267] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2024] [Accepted: 04/19/2024] [Indexed: 06/15/2024] Open
Abstract
Objective Understanding the neural correlates of naturalistic behavior is critical for extending and confirming the results obtained from trial-based experiments and designing generalizable brain-computer interfaces that can operate outside laboratory environments. In this study, we aimed to pinpoint consistent spectro-spatial features of neural activity in humans that can discriminate between naturalistic behavioral states. Approach We analyzed data from five participants using electrocorticography (ECoG) with broad spatial coverage. Spontaneous and naturalistic behaviors such as "Talking" and "Watching TV" were labeled from manually annotated videos. Linear discriminant analysis (LDA) was used to classify the two behavioral states. The parameters learned from the LDA were then used to determine whether the neural signatures driving classification performance are consistent across the participants. Main results Spectro-spatial feature values were consistently discriminative between the two labeled behavioral states across participants. Mainly, θ, α, and low and high γ in the postcentral gyrus, precentral gyrus, and temporal lobe showed significant classification performance and feature consistency across participants. Subject-specific performance exceeded 70%. Combining neural activity from multiple cortical regions generally does not improve decoding performance, suggesting that information regarding the behavioral state is non-additive as a function of the cortical region. Significance To the best of our knowledge, this is the first attempt to identify specific spectro-spatial neural correlates that consistently decode naturalistic and active behavioral states. The aim of this work is to serve as an initial starting point for developing brain-computer interfaces that can be generalized in a realistic setting and to further our understanding of the neural correlates of naturalistic behavior in humans.
Collapse
Affiliation(s)
- Abdulwahab Alasfour
- Department of Electrical Engineering, College of Engineering and Petroleum, Kuwait University, Kuwait City, Kuwait
| | - Vikash Gilja
- Department of Electrical and Computer Engineering, University of California, San Diego, CA, United States
| |
Collapse
|
12
|
Iwata T, Yanagisawa T, Ikegaya Y, Smallwood J, Fukuma R, Oshino S, Tani N, Khoo HM, Kishima H. Hippocampal sharp-wave ripples correlate with periods of naturally occurring self-generated thoughts in humans. Nat Commun 2024; 15:4078. [PMID: 38778048 PMCID: PMC11111804 DOI: 10.1038/s41467-024-48367-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 04/29/2024] [Indexed: 05/25/2024] Open
Abstract
Core features of human cognition highlight the importance of the capacity to focus on information distinct from events in the here and now, such as mind wandering. However, the brain mechanisms that underpin these self-generated states remain unclear. An emerging hypothesis is that self-generated states depend on the process of memory replay, which is linked to sharp-wave ripples (SWRs), which are transient high-frequency oscillations originating in the hippocampus. Local field potentials were recorded from the hippocampus of 10 patients with epilepsy for up to 15 days, and experience sampling was used to describe their association with ongoing thought patterns. The SWR rates were higher during extended periods of time when participants' ongoing thoughts were more vivid, less desirable, had more imaginable properties, and exhibited fewer correlations with an external task. These data suggest a role for SWR in the patterns of ongoing thoughts that humans experience in daily life.
Collapse
Affiliation(s)
- Takamitsu Iwata
- Department of Neurosurgery, Graduate School of Medicine, Osaka University, Osaka, 565-0871, Japan
| | - Takufumi Yanagisawa
- Department of Neurosurgery, Graduate School of Medicine, Osaka University, Osaka, 565-0871, Japan.
- Institute for Advanced Co-Creation Studies, Osaka University, Osaka, 565-0871, Japan.
| | - Yuji Ikegaya
- Laboratory of Chemical Pharmacology, Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, 113-0033, Japan
- Institute for AI and Beyond, The University of Tokyo, Tokyo, 113-0033, Japan
- National Institute of Information and Communications Technology, Center for Information and Neural Networks, Suita City, Osaka, 565-0871, Japan
| | - Jonathan Smallwood
- Department of Psychology, Queen's University, Kingston, ON, K7L 3N6, Canada
| | - Ryohei Fukuma
- Department of Neurosurgery, Graduate School of Medicine, Osaka University, Osaka, 565-0871, Japan
- Institute for Advanced Co-Creation Studies, Osaka University, Osaka, 565-0871, Japan
| | - Satoru Oshino
- Department of Neurosurgery, Graduate School of Medicine, Osaka University, Osaka, 565-0871, Japan
| | - Naoki Tani
- Department of Neurosurgery, Graduate School of Medicine, Osaka University, Osaka, 565-0871, Japan
| | - Hui Ming Khoo
- Department of Neurosurgery, Graduate School of Medicine, Osaka University, Osaka, 565-0871, Japan
| | - Haruhiko Kishima
- Department of Neurosurgery, Graduate School of Medicine, Osaka University, Osaka, 565-0871, Japan
| |
Collapse
|
13
|
Sadras N, Pesaran B, Shanechi MM. Event detection and classification from multimodal time series with application to neural data. J Neural Eng 2024; 21:026049. [PMID: 38513289 DOI: 10.1088/1741-2552/ad3678] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Accepted: 03/21/2024] [Indexed: 03/23/2024]
Abstract
The detection of events in time-series data is a common signal-processing problem. When the data can be modeled as a known template signal with an unknown delay in Gaussian noise, detection of the template signal can be done with a traditional matched filter. However, in many applications, the event of interest is represented in multimodal data consisting of both Gaussian and point-process time series. Neuroscience experiments, for example, can simultaneously record multimodal neural signals such as local field potentials (LFPs), which can be modeled as Gaussian, and neuronal spikes, which can be modeled as point processes. Currently, no method exists for event detection from such multimodal data, and as such our objective in this work is to develop a method to meet this need. Here we address this challenge by developing the multimodal event detector (MED) algorithm which simultaneously estimates event times and classes. To do this, we write a multimodal likelihood function for Gaussian and point-process observations and derive the associated maximum likelihood estimator of simultaneous event times and classes. We additionally introduce a cross-modal scaling parameter to account for model mismatch in real datasets. We validate this method in extensive simulations as well as in a neural spike-LFP dataset recorded during an eye-movement task, where the events of interest are eye movements with unknown times and directions. We show that the MED can successfully detect eye movement onset and classify eye movement direction. Further, the MED successfully combines information across data modalities, with multimodal performance exceeding unimodal performance. This method can facilitate applications such as the discovery of latent events in multimodal neural population activity and the development of brain-computer interfaces for naturalistic settings without constrained tasks or prior knowledge of event times.
Collapse
Affiliation(s)
- Nitin Sadras
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Bijan Pesaran
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Maryam M Shanechi
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
- Thomas Lord Department of Computer Science, Alfred E. Mann Department of Biomedical Engineering, and the Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, United States of America
| |
Collapse
|
14
|
Young JJ, Chan AHW, Jette N, Bender HA, Saad AE, Saez I, Panov F, Ghatan S, Yoo JY, Singh A, Fields MC, Marcuse LV, Mayberg HS. Elevated phase amplitude coupling as a depression biomarker in epilepsy. Epilepsy Behav 2024; 152:109659. [PMID: 38301454 PMCID: PMC10923038 DOI: 10.1016/j.yebeh.2024.109659] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 12/28/2023] [Accepted: 01/19/2024] [Indexed: 02/03/2024]
Abstract
Depression is prevalent in epilepsy patients and their intracranial brain activity recordings can be used to determine the types of brain activity that are associated with comorbid depression. We performed case-control comparison of spectral power and phase amplitude coupling (PAC) in 34 invasively monitored drug resistant epilepsy patients' brain recordings. The values of spectral power and PAC for one-minute segments out of every hour in a patient's study were correlated with pre-operative assessment of depressive symptoms by Beck Depression Inventory-II (BDI). We identified an elevated PAC signal (theta-alpha-beta phase (5-25 Hz)/gamma frequency (80-100 Hz) band) that is present in high BDI scores but not low BDI scores adult epilepsy patients in brain regions implicated in primary depression, including anterior cingulate cortex, amygdala and orbitofrontal cortex. Our results showed the application of PAC as a network-specific, electrophysiologic biomarker candidate for comorbid depression and its potential as treatment target for neuromodulation.
Collapse
Affiliation(s)
- James J Young
- Departments of Neurology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA.
| | - Andy Ho Wing Chan
- Departments of Neurology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA.
| | - Nathalie Jette
- Departments of Neurology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA; Population Health Science and Policy, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA.
| | - Heidi A Bender
- Weill Cornell Medicine, Department of Neurological Surgery, 525 East 68th Street, New York, NY 10021, USA
| | - Adam E Saad
- Departments of Neurology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA.
| | - Ignacio Saez
- Departments of Neurocience, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY, 10029, USA.
| | - Fedor Panov
- Departments of Neurosurgery, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA.
| | - Saadi Ghatan
- Departments of Neurosurgery, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA.
| | - Ji Yeoun Yoo
- Departments of Neurology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA.
| | - Anuradha Singh
- Departments of Neurology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA.
| | - Madeline C Fields
- Departments of Neurology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA.
| | - Lara V Marcuse
- Departments of Neurology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA.
| | - Helen S Mayberg
- Departments of Neurology, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA; Departments of Neurosurgery, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY 10029, USA; Center for Advanced Circuit Therapeutics, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, New York, NY, 10029, USA.
| |
Collapse
|
15
|
Ahmadipour P, Sani OG, Pesaran B, Shanechi MM. Multimodal subspace identification for modeling discrete-continuous spiking and field potential population activity. J Neural Eng 2024; 21:026001. [PMID: 38016450 PMCID: PMC10913727 DOI: 10.1088/1741-2552/ad1053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 10/23/2023] [Accepted: 11/28/2023] [Indexed: 11/30/2023]
Abstract
Objective.Learning dynamical latent state models for multimodal spiking and field potential activity can reveal their collective low-dimensional dynamics and enable better decoding of behavior through multimodal fusion. Toward this goal, developing unsupervised learning methods that are computationally efficient is important, especially for real-time learning applications such as brain-machine interfaces (BMIs). However, efficient learning remains elusive for multimodal spike-field data due to their heterogeneous discrete-continuous distributions and different timescales.Approach.Here, we develop a multiscale subspace identification (multiscale SID) algorithm that enables computationally efficient learning for modeling and dimensionality reduction for multimodal discrete-continuous spike-field data. We describe the spike-field activity as combined Poisson and Gaussian observations, for which we derive a new analytical SID method. Importantly, we also introduce a novel constrained optimization approach to learn valid noise statistics, which is critical for multimodal statistical inference of the latent state, neural activity, and behavior. We validate the method using numerical simulations and with spiking and local field potential population activity recorded during a naturalistic reach and grasp behavior.Main results.We find that multiscale SID accurately learned dynamical models of spike-field signals and extracted low-dimensional dynamics from these multimodal signals. Further, it fused multimodal information, thus better identifying the dynamical modes and predicting behavior compared to using a single modality. Finally, compared to existing multiscale expectation-maximization learning for Poisson-Gaussian observations, multiscale SID had a much lower training time while being better in identifying the dynamical modes and having a better or similar accuracy in predicting neural activity and behavior.Significance.Overall, multiscale SID is an accurate learning method that is particularly beneficial when efficient learning is of interest, such as for online adaptive BMIs to track non-stationary dynamics or for reducing offline training time in neuroscience investigations.
Collapse
Affiliation(s)
- Parima Ahmadipour
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Omid G Sani
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Bijan Pesaran
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Maryam M Shanechi
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
- Thomas Lord Department of Computer Science, Alfred E. Mann Department of Biomedical Engineering, and the Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, United States of America
| |
Collapse
|
16
|
Wu X, Zhang D, Li G, Gao X, Metcalfe B, Chen L. Data augmentation for invasive brain-computer interfaces based on stereo-electroencephalography (SEEG). J Neural Eng 2024; 21:016026. [PMID: 38237174 DOI: 10.1088/1741-2552/ad200e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2023] [Accepted: 01/18/2024] [Indexed: 02/23/2024]
Abstract
Objective.Deep learning is increasingly used for brain-computer interfaces (BCIs). However, the quantity of available data is sparse, especially for invasive BCIs. Data augmentation (DA) methods, such as generative models, can help to address this sparseness. However, all the existing studies on brain signals were based on convolutional neural networks and ignored the temporal dependence. This paper attempted to enhance generative models by capturing the temporal relationship from a time-series perspective.Approach. A conditional generative network (conditional transformer-based generative adversarial network (cTGAN)) based on the transformer model was proposed. The proposed method was tested using a stereo-electroencephalography (SEEG) dataset which was recorded from eight epileptic patients performing five different movements. Three other commonly used DA methods were also implemented: noise injection (NI), variational autoencoder (VAE), and conditional Wasserstein generative adversarial network with gradient penalty (cWGANGP). Using the proposed method, the artificial SEEG data was generated, and several metrics were used to compare the data quality, including visual inspection, cosine similarity (CS), Jensen-Shannon distance (JSD), and the effect on the performance of a deep learning-based classifier.Main results. Both the proposed cTGAN and the cWGANGP methods were able to generate realistic data, while NI and VAE outputted inferior samples when visualized as raw sequences and in a lower dimensional space. The cTGAN generated the best samples in terms of CS and JSD and outperformed cWGANGP significantly in enhancing the performance of a deep learning-based classifier (each of them yielding a significant improvement of 6% and 3.4%, respectively).Significance. This is the first time that DA methods have been applied to invasive BCIs based on SEEG. In addition, this study demonstrated the advantages of the model that preserves the temporal dependence from a time-series perspective.
Collapse
Affiliation(s)
- Xiaolong Wu
- The Centre for Autonomous Robotics (CENTAUR), Department of Electronic & Electrical Engineering, University of Bath, Bath, United Kingdom
| | - Dingguo Zhang
- The Centre for Autonomous Robotics (CENTAUR), Department of Electronic & Electrical Engineering, University of Bath, Bath, United Kingdom
| | - Guangye Li
- School of Mechanical Engineering, Shanghai Jiao Tong University, People's Republic of China
| | - Xin Gao
- The Centre for Autonomous Robotics (CENTAUR), Department of Electronic & Electrical Engineering, University of Bath, Bath, United Kingdom
| | - Benjamin Metcalfe
- The Centre for Autonomous Robotics (CENTAUR), Department of Electronic & Electrical Engineering, University of Bath, Bath, United Kingdom
| | - Liang Chen
- Liang Chen is with Huashan Hospital, Fudan University, People's Republic of China
| |
Collapse
|
17
|
Hurley ME, Sonig A, Herrington J, Storch EA, Lázaro-Muñoz G, Blumenthal-Barby J, Kostick-Quenet K. Ethical considerations for integrating multimodal computer perception and neurotechnology. Front Hum Neurosci 2024; 18:1332451. [PMID: 38435745 PMCID: PMC10904467 DOI: 10.3389/fnhum.2024.1332451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 01/30/2024] [Indexed: 03/05/2024] Open
Abstract
Background Artificial intelligence (AI)-based computer perception technologies (e.g., digital phenotyping and affective computing) promise to transform clinical approaches to personalized care in psychiatry and beyond by offering more objective measures of emotional states and behavior, enabling precision treatment, diagnosis, and symptom monitoring. At the same time, passive and continuous nature by which they often collect data from patients in non-clinical settings raises ethical issues related to privacy and self-determination. Little is known about how such concerns may be exacerbated by the integration of neural data, as parallel advances in computer perception, AI, and neurotechnology enable new insights into subjective states. Here, we present findings from a multi-site NCATS-funded study of ethical considerations for translating computer perception into clinical care and contextualize them within the neuroethics and neurorights literatures. Methods We conducted qualitative interviews with patients (n = 20), caregivers (n = 20), clinicians (n = 12), developers (n = 12), and clinician developers (n = 2) regarding their perspective toward using PC in clinical care. Transcripts were analyzed in MAXQDA using Thematic Content Analysis. Results Stakeholder groups voiced concerns related to (1) perceived invasiveness of passive and continuous data collection in private settings; (2) data protection and security and the potential for negative downstream/future impacts on patients of unintended disclosure; and (3) ethical issues related to patients' limited versus hyper awareness of passive and continuous data collection and monitoring. Clinicians and developers highlighted that these concerns may be exacerbated by the integration of neural data with other computer perception data. Discussion Our findings suggest that the integration of neurotechnologies with existing computer perception technologies raises novel concerns around dignity-related and other harms (e.g., stigma, discrimination) that stem from data security threats and the growing potential for reidentification of sensitive data. Further, our findings suggest that patients' awareness and preoccupation with feeling monitored via computer sensors ranges from hypo- to hyper-awareness, with either extreme accompanied by ethical concerns (consent vs. anxiety and preoccupation). These results highlight the need for systematic research into how best to implement these technologies into clinical care in ways that reduce disruption, maximize patient benefits, and mitigate long-term risks associated with the passive collection of sensitive emotional, behavioral and neural data.
Collapse
Affiliation(s)
- Meghan E. Hurley
- Center for Medical Ethics and Health Policy, Baylor College of Medicine, Houston, TX, United States
| | - Anika Sonig
- Center for Medical Ethics and Health Policy, Baylor College of Medicine, Houston, TX, United States
| | - John Herrington
- Department of Child and Adolescent Psychiatry and Behavioral Sciences, Children’s Hospital of Philadelphia, Philadelphia, PA, United States
| | - Eric A. Storch
- Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, United States
| | - Gabriel Lázaro-Muñoz
- Center for Bioethics, Harvard Medical School, Boston, MA, United States
- Department of Psychiatry and Behavioral Sciences, Massachusetts General Hospital, Boston, MA, United States
| | | | - Kristin Kostick-Quenet
- Center for Medical Ethics and Health Policy, Baylor College of Medicine, Houston, TX, United States
| |
Collapse
|
18
|
Vahidi P, Sani OG, Shanechi MM. Modeling and dissociation of intrinsic and input-driven neural population dynamics underlying behavior. Proc Natl Acad Sci U S A 2024; 121:e2212887121. [PMID: 38335258 PMCID: PMC10873612 DOI: 10.1073/pnas.2212887121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 12/03/2023] [Indexed: 02/12/2024] Open
Abstract
Neural dynamics can reflect intrinsic dynamics or dynamic inputs, such as sensory inputs or inputs from other brain regions. To avoid misinterpreting temporally structured inputs as intrinsic dynamics, dynamical models of neural activity should account for measured inputs. However, incorporating measured inputs remains elusive in joint dynamical modeling of neural-behavioral data, which is important for studying neural computations of behavior. We first show how training dynamical models of neural activity while considering behavior but not input or input but not behavior may lead to misinterpretations. We then develop an analytical learning method for linear dynamical models that simultaneously accounts for neural activity, behavior, and measured inputs. The method provides the capability to prioritize the learning of intrinsic behaviorally relevant neural dynamics and dissociate them from both other intrinsic dynamics and measured input dynamics. In data from a simulated brain with fixed intrinsic dynamics that performs different tasks, the method correctly finds the same intrinsic dynamics regardless of the task while other methods can be influenced by the task. In neural datasets from three subjects performing two different motor tasks with task instruction sensory inputs, the method reveals low-dimensional intrinsic neural dynamics that are missed by other methods and are more predictive of behavior and/or neural activity. The method also uniquely finds that the intrinsic behaviorally relevant neural dynamics are largely similar across the different subjects and tasks, whereas the overall neural dynamics are not. These input-driven dynamical models of neural-behavioral data can uncover intrinsic dynamics that may otherwise be missed.
Collapse
Affiliation(s)
- Parsa Vahidi
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA90089
| | - Omid G. Sani
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA90089
| | - Maryam M. Shanechi
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA90089
- Neuroscience Graduate Program, University of Southern California, Los Angeles, CA90089
- Thomas Lord Department of Computer Science and Alfred E. Mann Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA90089
| |
Collapse
|
19
|
Wang Q, Luo L, Xu N, Wang J, Yang R, Chen G, Ren J, Luan G, Fang F. Neural response properties predict perceived contents and locations elicited by intracranial electrical stimulation of human auditory cortex. Cereb Cortex 2024; 34:bhad517. [PMID: 38185991 DOI: 10.1093/cercor/bhad517] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 12/09/2023] [Accepted: 12/10/2023] [Indexed: 01/09/2024] Open
Abstract
Intracranial electrical stimulation (iES) of auditory cortex can elicit sound experiences with a variety of perceived contents (hallucination or illusion) and locations (contralateral or bilateral side), independent of actual acoustic inputs. However, the neural mechanisms underlying this elicitation heterogeneity remain undiscovered. Here, we collected subjective reports following iES at 3062 intracranial sites in 28 patients (both sexes) and identified 113 auditory cortical sites with iES-elicited sound experiences. We then decomposed the sound-induced intracranial electroencephalogram (iEEG) signals recorded from all 113 sites into time-frequency features. We found that the iES-elicited perceived contents can be predicted by the early high-γ features extracted from sound-induced iEEG. In contrast, the perceived locations elicited by stimulating hallucination sites and illusion sites are determined by the late high-γ and long-lasting α features, respectively. Our study unveils the crucial neural signatures of iES-elicited sound experiences in human and presents a new strategy to hearing restoration for individuals suffering from deafness.
Collapse
Affiliation(s)
- Qian Wang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China
- IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
- National Key Laboratory of General Artificial Intelligence, Peking University, Beijing 100871, China
| | - Lu Luo
- School of Psychology, Beijing Sport University, Beijing 100084, China
| | - Na Xu
- Division of Brain Sciences, Changping Laboratory, Beijing 102206, China
| | - Jing Wang
- Department of Neurology, Sanbo Brain Hospital, Capital Medical University, Beijing 100093, China
| | - Ruolin Yang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China
- IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
- Peking-Tsinghua Center for Life Sciences, Peking University, Beijing 100871, China
| | - Guanpeng Chen
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China
- IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
- Peking-Tsinghua Center for Life Sciences, Peking University, Beijing 100871, China
| | - Jie Ren
- Department of Functional Neurosurgery, Beijing Key Laboratory of Epilepsy, Sanbo Brain Hospital, Capital Medical University, Beijing 100093, China
- Epilepsy Center, Kunming Sanbo Brain Hospital, Kunming 650100 China
| | - Guoming Luan
- Department of Functional Neurosurgery, Beijing Key Laboratory of Epilepsy, Sanbo Brain Hospital, Capital Medical University, Beijing 100093, China
- Beijing Institute for Brain Disorders, Beijing 100069, China
| | - Fang Fang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China
- IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
- Peking-Tsinghua Center for Life Sciences, Peking University, Beijing 100871, China
| |
Collapse
|
20
|
Weng G, Clark K, Akbarian A, Noudoost B, Nategh N. Time-varying generalized linear models: characterizing and decoding neuronal dynamics in higher visual areas. Front Comput Neurosci 2024; 18:1273053. [PMID: 38348287 PMCID: PMC10859875 DOI: 10.3389/fncom.2024.1273053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2023] [Accepted: 01/09/2024] [Indexed: 02/15/2024] Open
Abstract
To create a behaviorally relevant representation of the visual world, neurons in higher visual areas exhibit dynamic response changes to account for the time-varying interactions between external (e.g., visual input) and internal (e.g., reward value) factors. The resulting high-dimensional representational space poses challenges for precisely quantifying individual factors' contributions to the representation and readout of sensory information during a behavior. The widely used point process generalized linear model (GLM) approach provides a powerful framework for a quantitative description of neuronal processing as a function of various sensory and non-sensory inputs (encoding) as well as linking particular response components to particular behaviors (decoding), at the level of single trials and individual neurons. However, most existing variations of GLMs assume the neural systems to be time-invariant, making them inadequate for modeling nonstationary characteristics of neuronal sensitivity in higher visual areas. In this review, we summarize some of the existing GLM variations, with a focus on time-varying extensions. We highlight their applications to understanding neural representations in higher visual areas and decoding transient neuronal sensitivity as well as linking physiology to behavior through manipulation of model components. This time-varying class of statistical models provide valuable insights into the neural basis of various visual behaviors in higher visual areas and hold significant potential for uncovering the fundamental computational principles that govern neuronal processing underlying various behaviors in different regions of the brain.
Collapse
Affiliation(s)
- Geyu Weng
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, United States
| | - Kelsey Clark
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, United States
| | - Amir Akbarian
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, United States
| | - Behrad Noudoost
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, United States
| | - Neda Nategh
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, United States
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, United States
| |
Collapse
|
21
|
Walder-Christensen K, Abdelaal K, Klein H, Thomas GE, Gallagher NM, Talbot A, Adamson E, Rawls A, Hughes D, Mague SD, Dzirasa K, Carlson DE. Electome network factors: Capturing emotional brain networks related to health and disease. CELL REPORTS METHODS 2024; 4:100691. [PMID: 38215761 PMCID: PMC10832286 DOI: 10.1016/j.crmeth.2023.100691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Revised: 10/17/2023] [Accepted: 12/21/2023] [Indexed: 01/14/2024]
Abstract
Therapeutic development for mental disorders has been slow despite the high worldwide prevalence of illness. Unfortunately, cellular and circuit insights into disease etiology have largely failed to generalize across individuals that carry the same diagnosis, reflecting an unmet need to identify convergent mechanisms that would facilitate optimal treatment. Here, we discuss how mesoscale networks can encode affect and other cognitive processes. These networks can be discovered through electrical functional connectome (electome) analysis, a method built upon explainable machine learning models for analyzing and interpreting mesoscale brain-wide signals in a behavioral context. We also outline best practices for identifying these generalizable, interpretable, and biologically relevant networks. Looking forward, translational electome analysis can span species and various moods, cognitive processes, or other brain states, supporting translational medicine. Thus, we argue that electome analysis provides potential translational biomarkers for developing next-generation therapeutics that exhibit high efficacy across heterogeneous disorders.
Collapse
Affiliation(s)
- Kathryn Walder-Christensen
- Department of Psychiatry and Behavioral Sciences, Duke University Medical Center, Durham, NC 27710, USA; Howard Hughes Medical Institute, Chevy Chase, MD 20815, USA
| | - Karim Abdelaal
- Department of Neurobiology, Duke University Medical Center, Durham, NC 27710, USA; Howard Hughes Medical Institute, Chevy Chase, MD 20815, USA
| | - Hunter Klein
- Department of Electrical and Computer Engineering, Duke University, Durham, NC 27710, USA
| | - Gwenaëlle E Thomas
- Department of Neurobiology, Duke University Medical Center, Durham, NC 27710, USA; Howard Hughes Medical Institute, Chevy Chase, MD 20815, USA
| | - Neil M Gallagher
- Department of Psychiatry, Weill Cornell Medical Center, New York City, NY 10065, USA
| | - Austin Talbot
- Howard Hughes Medical Institute, Chevy Chase, MD 20815, USA
| | - Elise Adamson
- Howard Hughes Medical Institute, Chevy Chase, MD 20815, USA; Department of Biomedical Engineering, Duke University, Durham, NC 27710, USA
| | - Ashleigh Rawls
- Department of Pharmacology and Cancer Biology, Duke University Medical Center, Durham, NC 27710, USA; Howard Hughes Medical Institute, Chevy Chase, MD 20815, USA
| | - Dalton Hughes
- Department of Neurobiology, Duke University Medical Center, Durham, NC 27710, USA; Howard Hughes Medical Institute, Chevy Chase, MD 20815, USA
| | - Stephen D Mague
- Department of Psychiatry and Behavioral Sciences, Duke University Medical Center, Durham, NC 27710, USA; Howard Hughes Medical Institute, Chevy Chase, MD 20815, USA
| | - Kafui Dzirasa
- Department of Psychiatry and Behavioral Sciences, Duke University Medical Center, Durham, NC 27710, USA; Department of Neurobiology, Duke University Medical Center, Durham, NC 27710, USA; Department of Neurosurgery, Duke University Medical Center, Durham, NC 27710, USA; Howard Hughes Medical Institute, Chevy Chase, MD 20815, USA; Department of Biomedical Engineering, Duke University, Durham, NC 27710, USA.
| | - David E Carlson
- Department of Biostatistics and Bioinformatics, Duke University Medical Center, Durham, NC 27710, USA; Department of Civil and Environmental Engineering, Duke University, Durham, NC 27710, USA.
| |
Collapse
|
22
|
Foffani G. To be or not to be hallucinating: Implications of hypnagogic/hypnopompic experiences and lucid dreaming for brain disorders. PNAS NEXUS 2024; 3:pgad442. [PMID: 38178978 PMCID: PMC10766414 DOI: 10.1093/pnasnexus/pgad442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Accepted: 12/06/2023] [Indexed: 01/06/2024]
Abstract
The boundaries between waking and sleeping-when falling asleep (hypnagogic) or waking up (hypnopompic)-can be challenging for our ability to monitor and interpret reality. Without proper understanding, bizarre but relatively normal hypnagogic/hypnopompic experiences can be misinterpreted as psychotic hallucinations (occurring, by definition, in the fully awake state), potentially leading to stigma and misdiagnosis in clinical contexts and to misconception and bias in research contexts. This Perspective proposes that conceptual and practical understanding for differentiating hallucinations from hypnagogic/hypnopompic experiences may be offered by lucid dreaming, the state in which one is aware of dreaming while sleeping. I first introduce a possible systematization of the phenomenological range of hypnagogic/hypnopompic experiences that can occur in the transition from awake to REM dreaming (including hypnagogic perceptions, transition symptoms, sleep paralysis, false awakenings, and out-of-body experiences). I then outline how metacognitive strategies used by lucid dreamers to gain/confirm oneiric lucidity could be tested for better differentiating hypnagogic/hypnopompic experiences from hallucinations. The relevance of hypnagogic/hypnopompic experiences and lucid dreaming is analyzed for schizophrenia and narcolepsy, and discussed for neurodegenerative diseases, particularly Lewy-body disorders (i.e. Parkinson's disease, Parkinson's disease dementia, and dementia with Lewy bodies), offering testable hypotheses for empirical investigation. Finally, emotionally positive lucid dreams triggered or enhanced by training/induction strategies or by a pathological process may have intrinsic therapeutic value if properly recognized and guided. The overall intention is to raise awareness and foster further research about the possible diagnostic, prognostic, and therapeutic implications of hypnagogic/hypnopompic experiences and lucid dreaming for brain disorders.
Collapse
Affiliation(s)
- Guglielmo Foffani
- HM CINAC (Centro Integral de Neurociencias Abarca Campal), Hospital Universitario HM Puerta del Sur, HM Hospitales, Madrid 28938, Spain
- Hospital Nacional de Parapléjicos, Toledo 45004, Spain
- CIBERNED, Instituto de Salud Carlos III, Madrid 28031, Spain
| |
Collapse
|
23
|
Sellers KK, Cohen JL, Khambhati AN, Fan JM, Lee AM, Chang EF, Krystal AD. Closed-loop neurostimulation for the treatment of psychiatric disorders. Neuropsychopharmacology 2024; 49:163-178. [PMID: 37369777 PMCID: PMC10700557 DOI: 10.1038/s41386-023-01631-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Revised: 05/31/2023] [Accepted: 06/02/2023] [Indexed: 06/29/2023]
Abstract
Despite increasing prevalence and huge personal and societal burden, psychiatric diseases still lack treatments which can control symptoms for a large fraction of patients. Increasing insight into the neurobiology underlying these diseases has demonstrated wide-ranging aberrant activity and functioning in multiple brain circuits and networks. Together with varied presentation and symptoms, this makes one-size-fits-all treatment a challenge. There has been a resurgence of interest in the use of neurostimulation as a treatment for psychiatric diseases. Initial studies using continuous open-loop stimulation, in which clinicians adjusted stimulation parameters during patient visits, showed promise but also mixed results. Given the periodic nature and fluctuations of symptoms often observed in psychiatric illnesses, the use of device-driven closed-loop stimulation may provide more effective therapy. The use of a biomarker, which is correlated with specific symptoms, to deliver stimulation only during symptomatic periods allows for the personalized therapy needed for such heterogeneous disorders. Here, we provide the reader with background motivating the use of closed-loop neurostimulation for the treatment of psychiatric disorders. We review foundational studies of open- and closed-loop neurostimulation for neuropsychiatric indications, focusing on deep brain stimulation, and discuss key considerations when designing and implementing closed-loop neurostimulation.
Collapse
Affiliation(s)
- Kristin K Sellers
- Department of Neurological Surgery, University of California, San Francisco, CA, USA
- Weill Institute for Neurosciences, University of California, San Francisco, CA, USA
| | - Joshua L Cohen
- Weill Institute for Neurosciences, University of California, San Francisco, CA, USA
- Department of Psychiatry and Behavioral Sciences, University of California, San Francisco, CA, USA
| | - Ankit N Khambhati
- Department of Neurological Surgery, University of California, San Francisco, CA, USA
- Weill Institute for Neurosciences, University of California, San Francisco, CA, USA
| | - Joline M Fan
- Weill Institute for Neurosciences, University of California, San Francisco, CA, USA
- Department of Neurology, University of California, San Francisco, CA, USA
| | - A Moses Lee
- Weill Institute for Neurosciences, University of California, San Francisco, CA, USA
- Department of Psychiatry and Behavioral Sciences, University of California, San Francisco, CA, USA
| | - Edward F Chang
- Department of Neurological Surgery, University of California, San Francisco, CA, USA
- Weill Institute for Neurosciences, University of California, San Francisco, CA, USA
| | - Andrew D Krystal
- Weill Institute for Neurosciences, University of California, San Francisco, CA, USA.
- Department of Psychiatry and Behavioral Sciences, University of California, San Francisco, CA, USA.
| |
Collapse
|
24
|
Abbaspourazad H, Erturk E, Pesaran B, Shanechi MM. Dynamical flexible inference of nonlinear latent factors and structures in neural population activity. Nat Biomed Eng 2024; 8:85-108. [PMID: 38082181 DOI: 10.1038/s41551-023-01106-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2022] [Accepted: 09/12/2023] [Indexed: 12/26/2023]
Abstract
Modelling the spatiotemporal dynamics in the activity of neural populations while also enabling their flexible inference is hindered by the complexity and noisiness of neural observations. Here we show that the lower-dimensional nonlinear latent factors and latent structures can be computationally modelled in a manner that allows for flexible inference causally, non-causally and in the presence of missing neural observations. To enable flexible inference, we developed a neural network that separates the model into jointly trained manifold and dynamic latent factors such that nonlinearity is captured through the manifold factors and the dynamics can be modelled in tractable linear form on this nonlinear manifold. We show that the model, which we named 'DFINE' (for 'dynamical flexible inference for nonlinear embeddings') achieves flexible inference in simulations of nonlinear dynamics and across neural datasets representing a diversity of brain regions and behaviours. Compared with earlier neural-network models, DFINE enables flexible inference, better predicts neural activity and behaviour, and better captures the latent neural manifold structure. DFINE may advance the development of neurotechnology and investigations in neuroscience.
Collapse
Affiliation(s)
- Hamidreza Abbaspourazad
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA
| | - Eray Erturk
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA
| | - Bijan Pesaran
- Departments of Neurosurgery, Neuroscience, and Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
| | - Maryam M Shanechi
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA.
- Thomas Lord Department of Computer Science, Alfred E. Mann Department of Biomedical Engineering, Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, USA.
| |
Collapse
|
25
|
Widge AS. Closing the loop in psychiatric deep brain stimulation: physiology, psychometrics, and plasticity. Neuropsychopharmacology 2024; 49:138-149. [PMID: 37415081 PMCID: PMC10700701 DOI: 10.1038/s41386-023-01643-y] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Revised: 05/28/2023] [Accepted: 06/20/2023] [Indexed: 07/08/2023]
Abstract
Deep brain stimulation (DBS) is an invasive approach to precise modulation of psychiatrically relevant circuits. Although it has impressive results in open-label psychiatric trials, DBS has also struggled to scale to and pass through multi-center randomized trials. This contrasts with Parkinson disease, where DBS is an established therapy treating thousands of patients annually. The core difference between these clinical applications is the difficulty of proving target engagement, and of leveraging the wide range of possible settings (parameters) that can be programmed in a given patient's DBS. In Parkinson's, patients' symptoms change rapidly and visibly when the stimulator is tuned to the correct parameters. In psychiatry, those same changes take days to weeks, limiting a clinician's ability to explore parameter space and identify patient-specific optimal settings. I review new approaches to psychiatric target engagement, with an emphasis on major depressive disorder (MDD). Specifically, I argue that better engagement may come by focusing on the root causes of psychiatric illness: dysfunction in specific, measurable cognitive functions and in the connectivity and synchrony of distributed brain circuits. I overview recent progress in both those domains, and how it may relate to other technologies discussed in companion articles in this issue.
Collapse
Affiliation(s)
- Alik S Widge
- Department of Psychiatry & Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA.
| |
Collapse
|
26
|
Nozari E, Bertolero MA, Stiso J, Caciagli L, Cornblath EJ, He X, Mahadevan AS, Pappas GJ, Bassett DS. Macroscopic resting-state brain dynamics are best described by linear models. Nat Biomed Eng 2024; 8:68-84. [PMID: 38082179 PMCID: PMC11357987 DOI: 10.1038/s41551-023-01117-y] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2020] [Accepted: 09/26/2023] [Indexed: 12/22/2023]
Abstract
It is typically assumed that large networks of neurons exhibit a large repertoire of nonlinear behaviours. Here we challenge this assumption by leveraging mathematical models derived from measurements of local field potentials via intracranial electroencephalography and of whole-brain blood-oxygen-level-dependent brain activity via functional magnetic resonance imaging. We used state-of-the-art linear and nonlinear families of models to describe spontaneous resting-state activity of 700 participants in the Human Connectome Project and 122 participants in the Restoring Active Memory project. We found that linear autoregressive models provide the best fit across both data types and three performance metrics: predictive power, computational complexity and the extent of the residual dynamics unexplained by the model. To explain this observation, we show that microscopic nonlinear dynamics can be counteracted or masked by four factors associated with macroscopic dynamics: averaging over space and over time, which are inherent to aggregated macroscopic brain activity, and observation noise and limited data samples, which stem from technological limitations. We therefore argue that easier-to-interpret linear models can faithfully describe macroscopic brain dynamics during resting-state conditions.
Collapse
Affiliation(s)
- Erfan Nozari
- Department of Mechanical Engineering, University of California, Riverside, CA, USA
- Department of Electrical and Computer Engineering, University of California, Riverside, CA, USA
- Department of Bioengineering, University of California, Riverside, CA, USA
| | - Maxwell A Bertolero
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
| | - Jennifer Stiso
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
- Department of Neuroscience, University of Pennsylvania, Philadelphia, PA, USA
| | - Lorenzo Caciagli
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
| | - Eli J Cornblath
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
- Department of Neuroscience, University of Pennsylvania, Philadelphia, PA, USA
| | - Xiaosong He
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
| | - Arun S Mahadevan
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
| | - George J Pappas
- Department of Electrical and Systems Engineering, University of Pennsylvania, Philadelphia, PA, USA
| | - Dani S Bassett
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA.
- Department of Electrical and Systems Engineering, University of Pennsylvania, Philadelphia, PA, USA.
- Department of Physics and Astronomy, University of Pennsylvania, Philadelphia, PA, USA.
- Department of Neurology, University of Pennsylvania, Philadelphia, PA, USA.
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA.
- Santa Fe Institute, Santa Fe, NM, USA.
| |
Collapse
|
27
|
Song CY, Shanechi MM. Unsupervised learning of stationary and switching dynamical system models from Poisson observations. J Neural Eng 2023; 20:066029. [PMID: 38083862 PMCID: PMC10714100 DOI: 10.1088/1741-2552/ad038d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 09/15/2023] [Accepted: 10/16/2023] [Indexed: 12/18/2023]
Abstract
Objective. Investigating neural population dynamics underlying behavior requires learning accurate models of the recorded spiking activity, which can be modeled with a Poisson observation distribution. Switching dynamical system models can offer both explanatory power and interpretability by piecing together successive regimes of simpler dynamics to capture more complex ones. However, in many cases, reliable regime labels are not available, thus demanding accurate unsupervised learning methods for Poisson observations. Existing learning methods, however, rely on inference of latent states in neural activity using the Laplace approximation, which may not capture the broader properties of densities and may lead to inaccurate learning. Thus, there is a need for new inference methods that can enable accurate model learning.Approach. To achieve accurate model learning, we derive a novel inference method based on deterministic sampling for Poisson observations called the Poisson Cubature Filter (PCF) and embed it in an unsupervised learning framework. This method takes a minimum mean squared error approach to estimation. Terms that are difficult to find analytically for Poisson observations are approximated in a novel way with deterministic sampling based on numerical integration and cubature rules.Main results. PCF enabled accurate unsupervised learning in both stationary and switching dynamical systems and largely outperformed prior Laplace approximation-based learning methods in both simulations and motor cortical spiking data recorded during a reaching task. These improvements were larger for smaller data sizes, showing that PCF-based learning was more data efficient and enabled more reliable regime identification. In experimental data and unsupervised with respect to behavior, PCF-based learning uncovered interpretable behavior-relevant regimes unlike prior learning methods.Significance. The developed unsupervised learning methods for switching dynamical systems can accurately uncover latent regimes and states in population spiking activity, with important applications in both basic neuroscience and neurotechnology.
Collapse
Affiliation(s)
- Christian Y Song
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Maryam M Shanechi
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
- Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, United States of America
- Alfred E. Mann Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
- Thomas Lord Department of Computer Science, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| |
Collapse
|
28
|
Breault MS, Sacré P, Fitzgerald ZB, Gale JT, Cullen KE, González-Martínez JA, Sarma SV. Internal states as a source of subject-dependent movement variability are represented by large-scale brain networks. Nat Commun 2023; 14:7837. [PMID: 38030611 PMCID: PMC10687170 DOI: 10.1038/s41467-023-43257-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Accepted: 11/03/2023] [Indexed: 12/01/2023] Open
Abstract
Humans' ability to adapt and learn relies on reflecting on past performance. These experiences form latent representations called internal states that induce movement variability that improves how we interact with our environment. Our study uncovered temporal dynamics and neural substrates of two states from ten subjects implanted with intracranial depth electrodes while they performed a goal-directed motor task with physical perturbations. We identified two internal states using state-space models: one tracking past errors and the other past perturbations. These states influenced reaction times and speed errors, revealing how subjects strategize from trial history. Using local field potentials from over 100 brain regions, we found large-scale brain networks such as the dorsal attention and default mode network modulate visuospatial attention based on recent performance and environmental feedback. Notably, these networks were more prominent in higher-performing subjects, emphasizing their role in improving motor performance by regulating movement variability through internal states.
Collapse
Affiliation(s)
- Macauley Smith Breault
- Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA.
| | - Pierre Sacré
- Department of Electrical Engineering and Computer Science, School of Engineering, University of Liège, Liège, Belgium
| | - Zachary B Fitzgerald
- Department of Neurology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | | | - Kathleen E Cullen
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA
| | | | - Sridevi V Sarma
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
29
|
Pousson JE, Shen YW, Lin YP, Voicikas A, Pipinis E, Bernhofs V, Burmistrova L, Griskova-Bulanova I. Exploring Spatio-Spectral Electroencephalogram Modulations of Imbuing Emotional Intent During Active Piano Playing. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4347-4356. [PMID: 37883285 DOI: 10.1109/tnsre.2023.3327740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2023]
Abstract
Imbuing emotional intent serves as a crucial modulator of music improvisation during active musical instrument playing. However, most improvisation-related neural endeavors have been gained without considering the emotional context. This study attempts to exploit reproducible spatio-spectral electroencephalogram (EEG) oscillations of emotional intent using a data-driven independent component analysis framework in an ecological multiday piano playing experiment. Through the four-day 32-ch EEG dataset of 10 professional players, we showed that EEG patterns were substantially affected by both intra- and inter-individual variability underlying the emotional intent of the dichotomized valence (positive vs. negative) and arousal (high vs. low) categories. Less than half (3-4) of the 10 participants analogously exhibited day-reproducible ( ≥ three days) spectral modulations at the right frontal beta in response to the valence contrast as well as the frontal central gamma and the superior parietal alpha to the arousal counterpart. In particular, the frontal engagement facilitates a better understanding of the frontal cortex (e.g., dorsolateral prefrontal cortex and anterior cingulate cortex) and its role in intervening emotional processes and expressing spectral signatures that are relatively resistant to natural EEG variability. Such ecologically vivid EEG findings may lead to better understanding of the development of a brain-computer music interface infrastructure capable of guiding the training, performance, and appreciation for emotional improvisatory status or actuating music interaction via emotional context.
Collapse
|
30
|
Chang H, Liu B, Zong Y, Lu C, Wang X. EEG-Based Parkinson's Disease Recognition via Attention-Based Sparse Graph Convolutional Neural Network. IEEE J Biomed Health Inform 2023; 27:5216-5224. [PMID: 37405893 DOI: 10.1109/jbhi.2023.3292452] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/07/2023]
Abstract
Parkinson's disease (PD) is a complicated neurological ailment that affects both the physical and mental wellness of elderly individuals which makes it problematic to diagnose in its initial stages. Electroencephalogram (EEG) promises to be an efficient and cost-effective method for promptly detecting cognitive impairment in PD. Nevertheless, prevailing diagnostic practices utilizing EEG features have failed to examine the functional connectivity among EEG channels and the response of associated brain areas causing an unsatisfactory level of precision. Here, we construct an attention-based sparse graph convolutional neural network (ASGCNN) for diagnosing PD. Our ASGCNN model uses a graph structure to represent channel relationships, the attention mechanism for selecting channels, and the L1 norm to capture channel sparsity. We conduct extensive experiments on the publicly available PD auditory oddball dataset, which consists of 24 PD patients (under ON/OFF drug status) and 24 matched controls, to validate the effectiveness of our method. Our results show that the proposed method provides better results compared to the publicly available baselines. The achieved scores for Recall, Precision, F1-score, Accuracy and Kappa measures are 90.36%, 88.43%, 88.41%, 87.67%, and 75.24%, respectively. Our study reveals that the frontal and temporal lobes show significant differences between PD patients and healthy individuals. In addition, EEG features extracted by ASGCNN demonstrate significant asymmetry in the frontal lobe among PD patients. These findings can offer a basis for the establishment of a clinical system for intelligent diagnosis of PD by using auditory cognitive impairment features.
Collapse
|
31
|
Garwood IC, Major AJ, Antonini MJ, Correa J, Lee Y, Sahasrabudhe A, Mahnke MK, Miller EK, Brown EN, Anikeeva P. Multifunctional fibers enable modulation of cortical and deep brain activity during cognitive behavior in macaques. SCIENCE ADVANCES 2023; 9:eadh0974. [PMID: 37801492 PMCID: PMC10558126 DOI: 10.1126/sciadv.adh0974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Accepted: 09/05/2023] [Indexed: 10/08/2023]
Abstract
Recording and modulating neural activity in vivo enables investigations of the neurophysiology underlying behavior and disease. However, there is a dearth of translational tools for simultaneous recording and localized receptor-specific modulation. We address this limitation by translating multifunctional fiber neurotechnology previously only available for rodent studies to enable cortical and subcortical neural recording and modulation in macaques. We record single-neuron and broader oscillatory activity during intracranial GABA infusions in the premotor cortex and putamen. By applying state-space models to characterize changes in electrophysiology, we uncover that neural activity evoked by a working memory task is reshaped by even a modest local inhibition. The recordings provide detailed insight into the electrophysiological effect of neurotransmitter receptor modulation in both cortical and subcortical structures in an awake macaque. Our results demonstrate a first-time application of multifunctional fibers for causal studies of neuronal activity in behaving nonhuman primates and pave the way for clinical translation of fiber-based neurotechnology.
Collapse
Affiliation(s)
- Indie C. Garwood
- Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Alex J. Major
- The Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Marc-Joseph Antonini
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Josefina Correa
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Youngbin Lee
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Materials Science and Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Atharva Sahasrabudhe
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Chemistry, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Meredith K. Mahnke
- The Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Earl K. Miller
- The Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Emery N. Brown
- Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, USA
- The Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Anesthesia, Critical Care, and Pain Medicine, Massachusetts General Hospital, Boston, MA, USA
- Institute for Medical Engineering and Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Anaesthesia, Harvard Medical School, Boston, MA, USA
| | - Polina Anikeeva
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Materials Science and Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
32
|
Rezaei MR, Jeoung H, Gharamani A, Saha U, Bhat V, Popovic MR, Yousefi A, Chen R, Lankarany M. Inferring cognitive state underlying conflict choices in verbal Stroop task using heterogeneous input discriminative-generative decoder model. J Neural Eng 2023; 20:056016. [PMID: 37473753 DOI: 10.1088/1741-2552/ace932] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Accepted: 07/20/2023] [Indexed: 07/22/2023]
Abstract
Objective. The subthalamic nucleus (STN) of the basal ganglia interacts with the medial prefrontal cortex (mPFC) and shapes a control loop, specifically when the brain receives contradictory information from either different sensory systems or conflicting information from sensory inputs and prior knowledge that developed in the brain. Experimental studies demonstrated that significant increases in theta activities (2-8 Hz) in both the STN and mPFC as well as increased phase synchronization between mPFC and STN are prominent features of conflict processing. While these neural features reflect the importance of STN-mPFC circuitry in conflict processing, a low-dimensional representation of the mPFC-STN interaction referred to as a cognitive state, that links neural activities generated by these sub-regions to behavioral signals (e.g. the response time), remains to be identified.Approach. Here, we propose a new model, namely, the heterogeneous input discriminative-generative decoder (HI-DGD) model, to infer a cognitive state underlying decision-making based on neural activities (STN and mPFC) and behavioral signals (individuals' response time) recorded in ten Parkinson's disease (PD) patients while they performed a Stroop task. PD patients may have conflict processing which is quantitatively (may be qualitative in some) different from healthy populations.Main results. Using extensive synthetic and experimental data, we showed that the HI-DGD model can diffuse information from neural and behavioral data simultaneously and estimate cognitive states underlying conflict and non-conflict trials significantly better than traditional methods. Additionally, the HI-DGD model identified which neural features made significant contributions to conflict and non-conflict choices. Interestingly, the estimated features match well with those reported in experimental studies.Significance. Finally, we highlight the capability of the HI-DGD model in estimating a cognitive state from a single trial of observation, which makes it appropriate to be utilized in closed-loop neuromodulation systems.
Collapse
Affiliation(s)
- Mohammad R Rezaei
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
- Krembil Research Institute, University Health Network (UHN), Toronto, ON, Canada
- KITE Research Institute, University Health Network (UHN), Toronto, ON, Canada
| | - Haseul Jeoung
- Krembil Research Institute, University Health Network (UHN), Toronto, ON, Canada
| | - Ayda Gharamani
- Krembil Research Institute, University Health Network (UHN), Toronto, ON, Canada
- Worcester Polytechnic Institute, MA, United States of America
| | - Utpal Saha
- Krembil Research Institute, University Health Network (UHN), Toronto, ON, Canada
| | - Venkat Bhat
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
- Department of Psychiatry, University Health Network and University of Toronto, Toronto, ON, Canada
| | - Milos R Popovic
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
- KITE Research Institute, University Health Network (UHN), Toronto, ON, Canada
| | - Ali Yousefi
- Worcester Polytechnic Institute, MA, United States of America
| | - Robert Chen
- Krembil Research Institute, University Health Network (UHN), Toronto, ON, Canada
| | - Milad Lankarany
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
- Krembil Research Institute, University Health Network (UHN), Toronto, ON, Canada
- KITE Research Institute, University Health Network (UHN), Toronto, ON, Canada
| |
Collapse
|
33
|
Sadras N, Sani OG, Ahmadipour P, Shanechi MM. Post-stimulus encoding of decision confidence in EEG: toward a brain-computer interface for decision making. J Neural Eng 2023; 20:056012. [PMID: 37524073 DOI: 10.1088/1741-2552/acec14] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Accepted: 07/31/2023] [Indexed: 08/02/2023]
Abstract
Objective.When making decisions, humans can evaluate how likely they are to be correct. If this subjective confidence could be reliably decoded from brain activity, it would be possible to build a brain-computer interface (BCI) that improves decision performance by automatically providing more information to the user if needed based on their confidence. But this possibility depends on whether confidence can be decoded right after stimulus presentation and before the response so that a corrective action can be taken in time. Although prior work has shown that decision confidence is represented in brain signals, it is unclear if the representation is stimulus-locked or response-locked, and whether stimulus-locked pre-response decoding is sufficiently accurate for enabling such a BCI.Approach.We investigate the neural correlates of confidence by collecting high-density electroencephalography (EEG) during a perceptual decision task with realistic stimuli. Importantly, we design our task to include a post-stimulus gap that prevents the confounding of stimulus-locked activity by response-locked activity and vice versa, and then compare with a task without this gap.Main results.We perform event-related potential and source-localization analyses. Our analyses suggest that the neural correlates of confidence are stimulus-locked, and that an absence of a post-stimulus gap could cause these correlates to incorrectly appear as response-locked. By preventing response-locked activity from confounding stimulus-locked activity, we then show that confidence can be reliably decoded from single-trial stimulus-locked pre-response EEG alone. We also identify a high-performance classification algorithm by comparing a battery of algorithms. Lastly, we design a simulated BCI framework to show that the EEG classification is accurate enough to build a BCI and that the decoded confidence could be used to improve decision making performance particularly when the task difficulty and cost of errors are high.Significance.Our results show feasibility of non-invasive EEG-based BCIs to improve human decision making.
Collapse
Affiliation(s)
- Nitin Sadras
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Omid G Sani
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Parima Ahmadipour
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Maryam M Shanechi
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
- Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
- Department of Computer Science, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
- Neuroscience Graduate Program University of Southern California, Los Angeles, CA, United States of America
| |
Collapse
|
34
|
Xiao J, Provenza NR, Asfouri J, Myers J, Mathura RK, Metzger B, Adkinson JA, Allawala AB, Pirtle V, Oswalt D, Shofty B, Robinson ME, Mathew SJ, Goodman WK, Pouratian N, Schrater PR, Patel AB, Tolias AS, Bijanki KR, Pitkow X, Sheth SA. Decoding Depression Severity From Intracranial Neural Activity. Biol Psychiatry 2023; 94:445-453. [PMID: 36736418 PMCID: PMC10394110 DOI: 10.1016/j.biopsych.2023.01.020] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/14/2022] [Revised: 01/09/2023] [Accepted: 01/25/2023] [Indexed: 02/05/2023]
Abstract
BACKGROUND Disorders of mood and cognition are prevalent, disabling, and notoriously difficult to treat. Fueling this challenge in treatment is a significant gap in our understanding of their neurophysiological basis. METHODS We recorded high-density neural activity from intracranial electrodes implanted in depression-relevant prefrontal cortical regions in 3 human subjects with severe depression. Neural recordings were labeled with depression severity scores across a wide dynamic range using an adaptive assessment that allowed sampling with a temporal frequency greater than that possible with typical rating scales. We modeled these data using regularized regression techniques with region selection to decode depression severity from the prefrontal recordings. RESULTS Across prefrontal regions, we found that reduced depression severity is associated with decreased low-frequency neural activity and increased high-frequency activity. When constraining our model to decode using a single region, spectral changes in the anterior cingulate cortex best predicted depression severity in all 3 subjects. Relaxing this constraint revealed unique, individual-specific sets of spatiospectral features predictive of symptom severity, reflecting the heterogeneous nature of depression. CONCLUSIONS The ability to decode depression severity from neural activity increases our fundamental understanding of how depression manifests in the human brain and provides a target neural signature for personalized neuromodulation therapies.
Collapse
Affiliation(s)
- Jiayang Xiao
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas; Department of Neuroscience, Baylor College of Medicine, Houston, Texas
| | - Nicole R Provenza
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas
| | - Joseph Asfouri
- Department of Electrical and Computer Engineering, Rice University, Houston, Texas
| | - John Myers
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas
| | - Raissa K Mathura
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas
| | - Brian Metzger
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas
| | - Joshua A Adkinson
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas
| | | | - Victoria Pirtle
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas
| | - Denise Oswalt
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas
| | - Ben Shofty
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas
| | - Meghan E Robinson
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas
| | - Sanjay J Mathew
- Department of Psychiatry, Baylor College of Medicine, Houston, Texas
| | - Wayne K Goodman
- Department of Psychiatry, Baylor College of Medicine, Houston, Texas
| | - Nader Pouratian
- Department of Neurological Surgery, UT Southwestern Medical Center, Dallas, Texas
| | - Paul R Schrater
- Department of Computer Science and Engineering, University of Minnesota, Minneapolis, Minnesota; Department of Psychology, University of Minnesota, Minneapolis, Minnesota
| | - Ankit B Patel
- Department of Neuroscience, Baylor College of Medicine, Houston, Texas; Department of Electrical and Computer Engineering, Rice University, Houston, Texas; Center for Neuroscience and Artificial Intelligence, Baylor College of Medicine, Houston, Texas
| | - Andreas S Tolias
- Department of Neuroscience, Baylor College of Medicine, Houston, Texas; Department of Electrical and Computer Engineering, Rice University, Houston, Texas; Center for Neuroscience and Artificial Intelligence, Baylor College of Medicine, Houston, Texas
| | - Kelly R Bijanki
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas
| | - Xaq Pitkow
- Department of Neuroscience, Baylor College of Medicine, Houston, Texas; Department of Electrical and Computer Engineering, Rice University, Houston, Texas; Center for Neuroscience and Artificial Intelligence, Baylor College of Medicine, Houston, Texas
| | - Sameer A Sheth
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas.
| |
Collapse
|
35
|
Cao D, Liu Q, Zhang J, Li J, Jiang T. State-specific modulation of mood using intracranial electrical stimulation of the orbitofrontal cortex. Brain Stimul 2023; 16:1112-1122. [PMID: 37467951 DOI: 10.1016/j.brs.2023.07.049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Revised: 07/09/2023] [Accepted: 07/13/2023] [Indexed: 07/21/2023] Open
Abstract
BACKGROUND Orbitofrontal cortex (OFC) is a promising target for intracranial electrical stimulation (iES) aimed at improving mood states. However, knowledge gaps remain regarding the underlying neural mechanisms of iES effects, such as the effect of the OFC target in comparison with other emotional network targets, the impact of brain state at the time of stimulation, and the neural response induced by iES at both local and network scales. OBJECTIVE Our study aims to address the neural mechanisms underlying the effects of iES in improving mood states. METHODS We conducted a study in 24 epilepsy patients who received iES through implanted electrodes in the emotional network and compared the effects of iES on multiple targets in the emotional network. RESULTS We found that only iES applied to the orbitofrontal cortex (OFC) led to mood improvement and changes in neural activity. We also observed that iES to the OFC suppressed the delta-theta power when the brain was in a low mood state. Moreover, the iES to the OFC decreased delta-theta power and increased gamma power at local regions within the emotional network, and enhanced the information flow through the frequency domain among regions within the emotional network. CONCLUSIONS These findings provide insight into the neural correlates of iES-induced mood improvement and support the potential of iES as a therapeutic intervention for mood disorders.
Collapse
Affiliation(s)
- Dan Cao
- Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Qihong Liu
- Key Laboratory for NeuroInformation of the Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Jiaqi Zhang
- Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Jin Li
- School of Psychology, Capital Normal University, Beijing, 100048, China.
| | - Tianzi Jiang
- Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China; Research Center for Augmented Intelligence, Zhejiang Lab, 311100, Hangzhou, China.
| |
Collapse
|
36
|
Su J, Zhu J, Song T, Chang H. Subject-Independent EEG Emotion Recognition Based on Genetically Optimized Projection Dictionary Pair Learning. Brain Sci 2023; 13:977. [PMID: 37508909 PMCID: PMC10377713 DOI: 10.3390/brainsci13070977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 06/18/2023] [Accepted: 06/19/2023] [Indexed: 07/30/2023] Open
Abstract
One of the primary challenges in Electroencephalogram (EEG) emotion recognition lies in developing models that can effectively generalize to new unseen subjects, considering the significant variability in EEG signals across individuals. To address the issue of subject-specific features, a suitable approach is to employ projection dictionary learning, which enables the identification of emotion-relevant features across different subjects. To accomplish the objective of pattern representation and discrimination for subject-independent EEG emotion recognition, we utilized the fast and efficient projection dictionary pair learning (PDPL) technique. PDPL involves the joint use of a synthesis dictionary and an analysis dictionary to enhance the representation of features. Additionally, to optimize the parameters of PDPL, which depend on experience, we applied the genetic algorithm (GA) to obtain the optimal solution for the model. We validated the effectiveness of our algorithm using leave-one-subject-out cross validation on three EEG emotion databases: SEED, MPED, and GAMEEMO. Our approach outperformed traditional machine learning methods, achieving an average accuracy of 69.89% on the SEED database, 24.11% on the MPED database, 64.34% for the two-class GAMEEMO, and 49.01% for the four-class GAMEEMO. These results highlight the potential of subject-independent EEG emotion recognition algorithms in the development of intelligent systems capable of recognizing and responding to human emotions in real-world scenarios.
Collapse
Affiliation(s)
- Jipu Su
- School of Information Science and Engineering, Southeast University, Nanjing 210096, China
| | - Jie Zhu
- School of Information Science and Engineering, Southeast University, Nanjing 210096, China
| | - Tiecheng Song
- School of Information Science and Engineering, Southeast University, Nanjing 210096, China
| | - Hongli Chang
- School of Information Science and Engineering, Southeast University, Nanjing 210096, China
| |
Collapse
|
37
|
Zhang X, Lu B, Chen C, Yang L, Chen W, Yao D, Hou J, Qiu J, Li F, Xu P. The correlation between upper body grip strength and resting-state EEG network. Med Biol Eng Comput 2023:10.1007/s11517-023-02865-4. [PMID: 37338738 DOI: 10.1007/s11517-023-02865-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Accepted: 06/07/2023] [Indexed: 06/21/2023]
Abstract
Current research in the field of neuroscience primarily focuses on the analysis of electroencephalogram (EEG) activities associated with movement within the central nervous system. However, there is a dearth of studies investigating the impact of prolonged individual strength training on the resting state of the brain. Therefore, it is crucial to examine the correlation between upper body grip strength and resting-state EEG networks. In this study, coherence analysis was utilized to construct resting-state EEG networks using the available datasets. A multiple linear regression model was established to examine the correlation between the brain network properties of individuals and their maximum voluntary contraction (MVC) during gripping tasks. The model was used to predict individual MVC. The beta and gamma frequency bands showed significant correlation between RSN connectivity and MVC (p < 0.05), particularly in left hemisphere frontoparietal and fronto-occipital connectivity. RSN properties were consistently correlated with MVC in both bands, with correlation coefficients greater than 0.60 (p < 0.01). Additionally, predicted MVC positively correlated with actual MVC, with a coefficient of 0.70 and root mean square error of 5.67 (p < 0.01). The results show that the resting-state EEG network is closely related to upper body grip strength, which can indirectly reflect an individual's muscle strength through the resting brain network.
Collapse
Affiliation(s)
- Xiabing Zhang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, No. 2006, Xiyuan Ave, West Hi-Tech Zone, Chengdu, 611731, Sichuan, China
- School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Bin Lu
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, No. 2006, Xiyuan Ave, West Hi-Tech Zone, Chengdu, 611731, Sichuan, China
- School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Chunli Chen
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, No. 2006, Xiyuan Ave, West Hi-Tech Zone, Chengdu, 611731, Sichuan, China
- School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Lei Yang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, No. 2006, Xiyuan Ave, West Hi-Tech Zone, Chengdu, 611731, Sichuan, China
- School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Wanjun Chen
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, No. 2006, Xiyuan Ave, West Hi-Tech Zone, Chengdu, 611731, Sichuan, China
- School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Dezhong Yao
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, No. 2006, Xiyuan Ave, West Hi-Tech Zone, Chengdu, 611731, Sichuan, China
- School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, 611731, China
- Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, Chengdu, 611731, China
- School of Electrical Engineering, Zhengzhou University, Zhengzhou, 450001, China
| | - Jingming Hou
- Department of Rehabilitation, Southwest Hospital, Army Medical University, Chongqing, 400038, China
| | - Jing Qiu
- Robotics Research Center, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Fali Li
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, No. 2006, Xiyuan Ave, West Hi-Tech Zone, Chengdu, 611731, Sichuan, China.
- School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, 611731, China.
- Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, Chengdu, 611731, China.
| | - Peng Xu
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, No. 2006, Xiyuan Ave, West Hi-Tech Zone, Chengdu, 611731, Sichuan, China.
- School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, 611731, China.
- Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, Chengdu, 611731, China.
- Radiation Oncology Key Laboratory of Sichuan Province, Chengdu, 610041, China.
| |
Collapse
|
38
|
Shirvalkar P, Prosky J, Chin G, Ahmadipour P, Sani OG, Desai M, Schmitgen A, Dawes H, Shanechi MM, Starr PA, Chang EF. First-in-human prediction of chronic pain state using intracranial neural biomarkers. Nat Neurosci 2023; 26:1090-1099. [PMID: 37217725 PMCID: PMC10330878 DOI: 10.1038/s41593-023-01338-z] [Citation(s) in RCA: 16] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Accepted: 04/18/2023] [Indexed: 05/24/2023]
Abstract
Chronic pain syndromes are often refractory to treatment and cause substantial suffering and disability. Pain severity is often measured through subjective report, while objective biomarkers that may guide diagnosis and treatment are lacking. Also, which brain activity underlies chronic pain on clinically relevant timescales, or how this relates to acute pain, remains unclear. Here four individuals with refractory neuropathic pain were implanted with chronic intracranial electrodes in the anterior cingulate cortex and orbitofrontal cortex (OFC). Participants reported pain metrics coincident with ambulatory, direct neural recordings obtained multiple times daily over months. We successfully predicted intraindividual chronic pain severity scores from neural activity with high sensitivity using machine learning methods. Chronic pain decoding relied on sustained power changes from the OFC, which tended to differ from transient patterns of activity associated with acute, evoked pain states during a task. Thus, intracranial OFC signals can be used to predict spontaneous, chronic pain state in patients.
Collapse
Affiliation(s)
- Prasad Shirvalkar
- UCSF Department of Anesthesiology and Perioperative Care, Division of Pain Medicine, University of California San Francisco, San Francisco, CA, USA.
- UCSF Department of Neurology, University of California San Francisco, San Francisco, CA, USA.
- UCSF Department of Neurological Surgery, University of California San Francisco, San Francisco, CA, USA.
- UCSF Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA.
| | - Jordan Prosky
- UCSF Department of Neurological Surgery, University of California San Francisco, San Francisco, CA, USA
- UCSF Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA
| | - Gregory Chin
- UCSF Department of Neurological Surgery, University of California San Francisco, San Francisco, CA, USA
| | - Parima Ahmadipour
- Departments of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA
| | - Omid G Sani
- Departments of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA
| | - Maansi Desai
- Department of Speech, Language, and Hearing Sciences, The University of Texas at Austin, Austin, TX, USA
| | - Ashlyn Schmitgen
- UCSF Department of Neurological Surgery, University of California San Francisco, San Francisco, CA, USA
- UCSF Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA
| | - Heather Dawes
- UCSF Department of Neurological Surgery, University of California San Francisco, San Francisco, CA, USA
- UCSF Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA
| | - Maryam M Shanechi
- Departments of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA
| | - Philip A Starr
- UCSF Department of Neurological Surgery, University of California San Francisco, San Francisco, CA, USA
- UCSF Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA
- UCSF Department of Physiology, University of California San Francisco, San Francisco, CA, USA
| | - Edward F Chang
- UCSF Department of Neurological Surgery, University of California San Francisco, San Francisco, CA, USA
- UCSF Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA
- UCSF Department of Physiology, University of California San Francisco, San Francisco, CA, USA
| |
Collapse
|
39
|
Ahmadipour P, Sani OG, Pesaran B, Shanechi MM. Multimodal subspace identification for modeling discrete-continuous spiking and field potential population activity. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.26.542509. [PMID: 37398400 PMCID: PMC10312539 DOI: 10.1101/2023.05.26.542509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/04/2023]
Abstract
Learning dynamical latent state models for multimodal spiking and field potential activity can reveal their collective low-dimensional dynamics and enable better decoding of behavior through multimodal fusion. Toward this goal, developing unsupervised learning methods that are computationally efficient is important, especially for real-time learning applications such as brain-machine interfaces (BMIs). However, efficient learning remains elusive for multimodal spike-field data due to their heterogeneous discrete-continuous distributions and different timescales. Here, we develop a multiscale subspace identification (multiscale SID) algorithm that enables computationally efficient modeling and dimensionality reduction for multimodal discrete-continuous spike-field data. We describe the spike-field activity as combined Poisson and Gaussian observations, for which we derive a new analytical subspace identification method. Importantly, we also introduce a novel constrained optimization approach to learn valid noise statistics, which is critical for multimodal statistical inference of the latent state, neural activity, and behavior. We validate the method using numerical simulations and spike-LFP population activity recorded during a naturalistic reach and grasp behavior. We find that multiscale SID accurately learned dynamical models of spike-field signals and extracted low-dimensional dynamics from these multimodal signals. Further, it fused multimodal information, thus better identifying the dynamical modes and predicting behavior compared to using a single modality. Finally, compared to existing multiscale expectation-maximization learning for Poisson-Gaussian observations, multiscale SID had a much lower computational cost while being better in identifying the dynamical modes and having a better or similar accuracy in predicting neural activity. Overall, multiscale SID is an accurate learning method that is particularly beneficial when efficient learning is of interest.
Collapse
|
40
|
Widge AS. Closed-Loop Deep Brain Stimulation for Psychiatric Disorders. Harv Rev Psychiatry 2023; 31:162-171. [PMID: 37171475 PMCID: PMC10188203 DOI: 10.1097/hrp.0000000000000367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
ABSTRACT Deep brain stimulation (DBS) is a well-established approach to treating medication-refractory neurological disorders and holds promise for treating psychiatric disorders. Despite strong open-label results in extremely refractory patients, DBS has struggled to meet endpoints in randomized controlled trials. A major challenge is stimulation "dosing"-DBS systems have many adjustable parameters, and clinicians receive little feedback on whether they have chosen the correct parameters for an individual patient. Multiple groups have proposed closed loop technologies as a solution. These systems sense electrical activity, identify markers of an (un)desired state, then automatically deliver or adjust stimulation to alter that electrical state. Closed loop DBS has been successfully deployed in movement disorders and epilepsy. The availability of that technology, as well as advances in opportunities for invasive research with neurosurgical patients, has yielded multiple pilot demonstrations in psychiatric illness. Those demonstrations split into two schools of thought, one rooted in well-established diagnoses and symptom scales, the other in the more experimental Research Domain Criteria (RDoC) framework. Both are promising, and both are limited by the boundaries of current stimulation technology. They are in turn driving advances in implantable recording hardware, signal processing, and stimulation paradigms. The combination of these advances is likely to change both our understanding of psychiatric neurobiology and our treatment toolbox, though the timeframe may be limited by the realities of implantable device development.
Collapse
Affiliation(s)
- Alik S Widge
- From the Department of Psychiatry & Behavioral Sciences and Medical Discovery Team on Addictions, University of Minnesota
| |
Collapse
|
41
|
Saez I, Gu X. Invasive Computational Psychiatry. Biol Psychiatry 2023; 93:661-670. [PMID: 36641365 PMCID: PMC10038930 DOI: 10.1016/j.biopsych.2022.09.032] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 08/25/2022] [Accepted: 09/27/2022] [Indexed: 01/16/2023]
Abstract
Computational psychiatry, a relatively new yet prolific field that aims to understand psychiatric disorders with formal theories about the brain, has seen tremendous growth in the past decade. Despite initial excitement, actual progress made by computational psychiatry seems stagnant. Meanwhile, understanding of the human brain has benefited tremendously from recent progress in intracranial neuroscience. Specifically, invasive techniques such as stereotactic electroencephalography, electrocorticography, and deep brain stimulation have provided a unique opportunity to precisely measure and causally modulate neurophysiological activity in the living human brain. In this review, we summarize progress and drawbacks in both computational psychiatry and invasive electrophysiology and propose that their combination presents a highly promising new direction-invasive computational psychiatry. The value of this approach is at least twofold. First, it advances our mechanistic understanding of the neural computations of mental states by providing a spatiotemporally precise depiction of neural activity that is traditionally unattainable using noninvasive techniques with human subjects. Second, it offers a direct and immediate way to modulate brain states through stimulation of algorithmically defined neural regions and circuits (i.e., algorithmic targeting), thus providing both causal and therapeutic insights. We then present depression as a use case where the combination of computational and invasive approaches has already shown initial success. We conclude by outlining future directions as a road map for this exciting new field as well as presenting cautions about issues such as ethical concerns and generalizability of findings.
Collapse
Affiliation(s)
- Ignacio Saez
- Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York.
| | - Xiaosi Gu
- Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, New York; Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York.
| |
Collapse
|
42
|
Basu I, Yousefi A, Crocker B, Zelmann R, Paulk AC, Peled N, Ellard KK, Weisholtz DS, Cosgrove GR, Deckersbach T, Eden UT, Eskandar EN, Dougherty DD, Cash SS, Widge AS. Closed-loop enhancement and neural decoding of cognitive control in humans. Nat Biomed Eng 2023; 7:576-588. [PMID: 34725508 PMCID: PMC9056584 DOI: 10.1038/s41551-021-00804-y] [Citation(s) in RCA: 20] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2020] [Accepted: 09/02/2021] [Indexed: 12/20/2022]
Abstract
Deficits in cognitive control-that is, in the ability to withhold a default pre-potent response in favour of a more adaptive choice-are common in depression, anxiety, addiction and other mental disorders. Here we report proof-of-concept evidence that, in participants undergoing intracranial epilepsy monitoring, closed-loop direct stimulation of the internal capsule or striatum, especially the dorsal sites, enhances the participants' cognitive control during a conflict task. We also show that closed-loop stimulation upon the detection of lapses in cognitive control produced larger behavioural changes than open-loop stimulation, and that task performance for single trials can be directly decoded from the activity of a small number of electrodes via neural features that are compatible with existing closed-loop brain implants. Closed-loop enhancement of cognitive control might remediate underlying cognitive deficits and aid the treatment of severe mental disorders.
Collapse
Affiliation(s)
- Ishita Basu
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | - Ali Yousefi
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
- Departments of Computer Science and Neuroscience, Worcester Polytechnic Institute, Worcester, MA, USA
| | - Britni Crocker
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Rina Zelmann
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Angelique C Paulk
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Noam Peled
- Department of Radiology, MGH/HST Martinos Center for Biomedical Imaging and Harvard Medical School, Boston, MA, USA
| | - Kristen K Ellard
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | | | - G Rees Cosgrove
- Department of Neurological Surgery, Brigham & Womens Hospital, Boston, MA, USA
| | - Thilo Deckersbach
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | - Uri T Eden
- Department of Mathematics and Statistics, Boston University, Boston, MA, USA
| | - Emad N Eskandar
- Department of Neurological Surgery, Massachusetts General Hospital, Boston, MA, USA
- Department of Neurological Surgery, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Darin D Dougherty
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | - Sydney S Cash
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Alik S Widge
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA.
- Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA.
| |
Collapse
|
43
|
Vahidi P, Sani OG, Shanechi MM. Modeling and dissociation of intrinsic and input-driven neural population dynamics underlying behavior. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.14.532554. [PMID: 36993213 PMCID: PMC10055042 DOI: 10.1101/2023.03.14.532554] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Neural dynamics can reflect intrinsic dynamics or dynamic inputs, such as sensory inputs or inputs from other regions. To avoid misinterpreting temporally-structured inputs as intrinsic dynamics, dynamical models of neural activity should account for measured inputs. However, incorporating measured inputs remains elusive in joint dynamical modeling of neural-behavioral data, which is important for studying neural computations of a specific behavior. We first show how training dynamical models of neural activity while considering behavior but not input, or input but not behavior may lead to misinterpretations. We then develop a novel analytical learning method that simultaneously accounts for neural activity, behavior, and measured inputs. The method provides the new capability to prioritize the learning of intrinsic behaviorally relevant neural dynamics and dissociate them from both other intrinsic dynamics and measured input dynamics. In data from a simulated brain with fixed intrinsic dynamics that performs different tasks, the method correctly finds the same intrinsic dynamics regardless of task while other methods can be influenced by the change in task. In neural datasets from three subjects performing two different motor tasks with task instruction sensory inputs, the method reveals low-dimensional intrinsic neural dynamics that are missed by other methods and are more predictive of behavior and/or neural activity. The method also uniquely finds that the intrinsic behaviorally relevant neural dynamics are largely similar across the three subjects and two tasks whereas the overall neural dynamics are not. These input-driven dynamical models of neural-behavioral data can uncover intrinsic dynamics that may otherwise be missed.
Collapse
|
44
|
Bergeron D, Iorio-Morin C, Bonizzato M, Lajoie G, Orr Gaucher N, Racine É, Weil AG. Use of Invasive Brain-Computer Interfaces in Pediatric Neurosurgery: Technical and Ethical Considerations. J Child Neurol 2023; 38:223-238. [PMID: 37116888 PMCID: PMC10226009 DOI: 10.1177/08830738231167736] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 02/11/2023] [Accepted: 03/17/2023] [Indexed: 04/30/2023]
Abstract
Invasive brain-computer interfaces hold promise to alleviate disabilities in individuals with neurologic injury, with fully implantable brain-computer interface systems expected to reach the clinic in the upcoming decade. Children with severe neurologic disabilities, like quadriplegic cerebral palsy or cervical spine trauma, could benefit from this technology. However, they have been excluded from clinical trials of intracortical brain-computer interface to date. In this manuscript, we discuss the ethical considerations related to the use of invasive brain-computer interface in children with severe neurologic disabilities. We first review the technical hardware and software considerations for the application of intracortical brain-computer interface in children. We then discuss ethical issues related to motor brain-computer interface use in pediatric neurosurgery. Finally, based on the input of a multidisciplinary panel of experts in fields related to brain-computer interface (functional and restorative neurosurgery, pediatric neurosurgery, mathematics and artificial intelligence research, neuroengineering, pediatric ethics, and pragmatic ethics), we then formulate initial recommendations regarding the clinical use of invasive brain-computer interfaces in children.
Collapse
Affiliation(s)
- David Bergeron
- Division of Neurosurgery, Université de Montréal, Montreal, Québec, Canada
| | | | - Marco Bonizzato
- Electrical Engineering Department, Polytechnique Montréal, Montreal, Québec, Canada
- Neuroscience Department and Centre
interdisciplinaire de recherche sur le cerveau et l’apprentissage (CIRCA), Université de Montréal, Montréal, Québec, Canada
| | - Guillaume Lajoie
- Mathematics and Statistics Department, Université de Montréal, Montreal, Québec, Canada
- Mila - Québec AI Institute, Montréal,
Québec, Canada
| | - Nathalie Orr Gaucher
- Department of Pediatric Emergency
Medicine, CHU Sainte-Justine, Montréal, Québec, Canada
- Bureau de l’Éthique clinique, Faculté
de médecine de l’Université de Montréal, Montreal, Québec, Canada
| | - Éric Racine
- Pragmatic Research Unit, Institute de
Recherche Clinique de Montréal (IRCM), Montreal, Québec, Canada
- Department of Medicine and Department
of Social and Preventative Medicine, Université de Montréal, Montréal, Québec, Canada
| | - Alexander G. Weil
- Division of Neurosurgery, Department
of Surgery, Centre Hospitalier Universitaire Sainte-Justine (CHUSJ), Département de
Pédiatrie, Université de Montréal, Montreal, Québec, Canada
- Department of Neuroscience, Université de Montréal, Montréal, Québec, Canada
- Brain and Development Research Axis,
CHU Sainte-Justine Research Center, Montréal, Québec, Canada
| |
Collapse
|
45
|
Qiu YF, Yin XT, Wang ZY, Yang R, Coid J, Chen XC, Hu JM. Status of mandatory treatment of mentally ill offenders without criminal responsibility in China: Information from 5,262 mandatory treatment judgments. Front Psychiatry 2023; 14:1129954. [PMID: 37077279 PMCID: PMC10106559 DOI: 10.3389/fpsyt.2023.1129954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 03/13/2023] [Indexed: 04/21/2023] Open
Abstract
Background To avoid public health risks, all governments ensure monitoring and treatment of mentally ill persons if they offend and assess their level of criminal responsibility. The Criminal Procedure Law of the People's Republic of China (2013) instituted special procedures. However, there are few articles in English which explain the implementation of mandatory treatment procedures in China. Methods We collected 5,262 qualified documents from 2013 to 2021 from the China Judgments Documents Online. We analyzed social demographic characteristics, trial-related information as well as the mandatory treatment-related content, to investigate the mandatory treatment of China's mentally ill offenders without criminal responsibility, from 2013 to 2021. Simple descriptive statistics and chi-square tests were used to compare differences among several types of documents. Results There was an overall change trend of the number of documents: increasing year by year from 2013 to 2019 after the implementation of the new law, but with sharp decrease in 2020 and 2021 during covid-19 pandemic. From 2013 to 2021, a total of 3,854 people had applications made for mandatory treatment, of whom 3,747 (97.2%) were given mandatory treatment, 107 (2.8%) had applications rejected. "Schizophrenia and other psychotic disorders" was the most common diagnosis in both groups and all offenders receiving mandatory treatment (3,747, 100.0%) were considered to have no criminal responsibility. A total of 1,294 patients had applications made for relief of mandatory treatment, of whom 827 (63.9%) were subsequently approved for relief, 467 (36.1%) were rejected. A total of 118 patients had applications for relief two or more times, and 56 (47.5%) were finally relieved. Conclusion Our study presents the Chinese model of a criminal mandatory treatment system to the international community which has been in operation since the implementation of the new law. Legislatory changes and covid-19 pandemic can have effect on the number of mandatory treatment cases. Patients, their close relatives and mandatory treatment institutions have the right to apply for relief from mandatory treatment, but the final decision in China is taken by the court.
Collapse
Affiliation(s)
- Yu-Feng Qiu
- West China School of Basic Medical Sciences and Forensic Medicine, Sichuan University, Chengdu, China
| | - Xiao-Tong Yin
- West China School of Basic Medical Sciences and Forensic Medicine, Sichuan University, Chengdu, China
| | - Zi-Ye Wang
- West China School of Basic Medical Sciences and Forensic Medicine, Sichuan University, Chengdu, China
| | - Rui Yang
- West China School of Basic Medical Sciences and Forensic Medicine, Sichuan University, Chengdu, China
| | - Jeremy Coid
- Brain Research Center and Mental Health Center, West China Hospital of Sichuan University, Chengdu, China
- Wolfson Institute of Preventive Medicine, Queen Mary University of London, London, United Kingdom
| | - Xia-Can Chen
- West China School of Basic Medical Sciences and Forensic Medicine, Sichuan University, Chengdu, China
- *Correspondence: Xia-Can Chen, ; Jun-Mei Hu,
| | - Jun-Mei Hu
- West China School of Basic Medical Sciences and Forensic Medicine, Sichuan University, Chengdu, China
- *Correspondence: Xia-Can Chen, ; Jun-Mei Hu,
| |
Collapse
|
46
|
Fang H, Yang Y. Predictive neuromodulation of cingulo-frontal neural dynamics in major depressive disorder using a brain-computer interface system: A simulation study. Front Comput Neurosci 2023; 17:1119685. [PMID: 36950505 PMCID: PMC10025398 DOI: 10.3389/fncom.2023.1119685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Accepted: 02/15/2023] [Indexed: 03/08/2023] Open
Abstract
Introduction Deep brain stimulation (DBS) is a promising therapy for treatment-resistant major depressive disorder (MDD). MDD involves the dysfunction of a brain network that can exhibit complex nonlinear neural dynamics in multiple frequency bands. However, current open-loop and responsive DBS methods cannot track the complex multiband neural dynamics in MDD, leading to imprecise regulation of symptoms, variable treatment effects among patients, and high battery power consumption. Methods Here, we develop a closed-loop brain-computer interface (BCI) system of predictive neuromodulation for treating MDD. We first use a biophysically plausible ventral anterior cingulate cortex (vACC)-dorsolateral prefrontal cortex (dlPFC) neural mass model of MDD to simulate nonlinear and multiband neural dynamics in response to DBS. We then use offline system identification to build a dynamic model that predicts the DBS effect on neural activity. We next use the offline identified model to design an online BCI system of predictive neuromodulation. The online BCI system consists of a dynamic brain state estimator and a model predictive controller. The brain state estimator estimates the MDD brain state from the history of neural activity and previously delivered DBS patterns. The predictive controller takes the estimated MDD brain state as the feedback signal and optimally adjusts DBS to regulate the MDD neural dynamics to therapeutic targets. We use the vACC-dlPFC neural mass model as a simulation testbed to test the BCI system and compare it with state-of-the-art open-loop and responsive DBS treatments of MDD. Results We demonstrate that our dynamic model accurately predicts nonlinear and multiband neural activity. Consequently, the predictive neuromodulation system accurately regulates the neural dynamics in MDD, resulting in significantly smaller control errors and lower DBS battery power consumption than open-loop and responsive DBS. Discussion Our results have implications for developing future precisely-tailored clinical closed-loop DBS treatments for MDD.
Collapse
Affiliation(s)
- Hao Fang
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL, United States
| | - Yuxiao Yang
- Ministry of Education (MOE) Frontier Science Center for Brain Science and Brain-Machine Integration, Zhejiang University, Hangzhou, Zhejiang, China
- State Key Laboratory of Brain-Machine Intelligence, Zhejiang University, Hangzhou, Zhejiang, China
- College of Computer Science and Technology, Zhejiang University, Hangzhou, Zhejiang, China
- Department of Neurosurgery, Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
- *Correspondence: Yuxiao Yang
| |
Collapse
|
47
|
Saalmann YB, Mofakham S, Mikell CB, Djuric PM. Microscale multicircuit brain stimulation: Achieving real-time brain state control for novel applications. CURRENT RESEARCH IN NEUROBIOLOGY 2022; 4:100071. [PMID: 36619175 PMCID: PMC9816916 DOI: 10.1016/j.crneur.2022.100071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 11/30/2022] [Accepted: 12/19/2022] [Indexed: 12/30/2022] Open
Abstract
Neurological and psychiatric disorders typically result from dysfunction across multiple neural circuits. Most of these disorders lack a satisfactory neuromodulation treatment. However, deep brain stimulation (DBS) has been successful in a limited number of disorders; DBS typically targets one or two brain areas with single contacts on relatively large electrodes, allowing for only coarse modulation of circuit function. Because of the dysfunction in distributed neural circuits - each requiring fine, tailored modulation - that characterizes most neuropsychiatric disorders, this approach holds limited promise. To develop the next generation of neuromodulation therapies, we will have to achieve fine-grained, closed-loop control over multiple neural circuits. Recent work has demonstrated spatial and frequency selectivity using microstimulation with many small, closely-spaced contacts, mimicking endogenous neural dynamics. Using custom electrode design and stimulation parameters, it should be possible to achieve bidirectional control over behavioral outcomes, such as increasing or decreasing arousal during central thalamic stimulation. Here, we discuss one possible approach, which we term microscale multicircuit brain stimulation (MMBS). We discuss how machine learning leverages behavioral and neural data to find optimal stimulation parameters across multiple contacts, to drive the brain towards desired states associated with behavioral goals. We expound a mathematical framework for MMBS, where behavioral and neural responses adjust the model in real-time, allowing us to adjust stimulation in real-time. These technologies will be critical to the development of the next generation of neurostimulation therapies, which will allow us to treat problems like disorders of consciousness and cognition.
Collapse
Affiliation(s)
- Yuri B. Saalmann
- Department of Psychology, University of Wisconsin-Madison, Madison, WI, USA
- Wisconsin National Primate Research Center, University of Wisconsin-Madison, Madison, WI, USA
| | - Sima Mofakham
- Department of Neurological Surgery, Stony Brook University Hospital, Stony Brook, NY, USA
- Department of Electrical and Computer Engineering, Stony Brook University, Stony Brook, NY, USA
| | - Charles B. Mikell
- Department of Neurological Surgery, Stony Brook University Hospital, Stony Brook, NY, USA
| | - Petar M. Djuric
- Department of Electrical and Computer Engineering, Stony Brook University, Stony Brook, NY, USA
| |
Collapse
|
48
|
Overcoming the Domain Gap in Neural Action Representations. Int J Comput Vis 2022. [DOI: 10.1007/s11263-022-01713-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
AbstractRelating behavior to brain activity in animals is a fundamental goal in neuroscience, with practical applications in building robust brain-machine interfaces. However, the domain gap between individuals is a major issue that prevents the training of general models that work on unlabeled subjects. Since 3D pose data can now be reliably extracted from multi-view video sequences without manual intervention, we propose to use it to guide the encoding of neural action representations together with a set of neural and behavioral augmentations exploiting the properties of microscopy imaging. To test our method, we collect a large dataset that features flies and their neural activity. To reduce the domain gap, during training, we mix features of neural and behavioral data across flies that seem to be performing similar actions. To show our method can generalize further neural modalities and other downstream tasks, we test our method on a human neural Electrocorticography dataset, and another RGB video data of human activities from different viewpoints. We believe our work will enable more robust neural decoding algorithms to be used in future brain-machine interfaces.
Collapse
|
49
|
Song CY, Hsieh HL, Pesaran B, Shanechi MM. Modeling and inference methods for switching regime-dependent dynamical systems with multiscale neural observations. J Neural Eng 2022; 19. [PMID: 36261030 DOI: 10.1088/1741-2552/ac9b94] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Accepted: 10/19/2022] [Indexed: 01/11/2023]
Abstract
Objective.Realizing neurotechnologies that enable long-term neural recordings across multiple spatial-temporal scales during naturalistic behaviors requires new modeling and inference methods that can simultaneously address two challenges. First, the methods should aggregate information across all activity scales from multiple recording sources such as spiking and field potentials. Second, the methods should detect changes in the regimes of behavior and/or neural dynamics during naturalistic scenarios and long-term recordings. Prior regime detection methods are developed for a single scale of activity rather than multiscale activity, and prior multiscale methods have not considered regime switching and are for stationary cases.Approach.Here, we address both challenges by developing a switching multiscale dynamical system model and the associated filtering and smoothing methods. This model describes the encoding of an unobserved brain state in multiscale spike-field activity. It also allows for regime-switching dynamics using an unobserved regime state that dictates the dynamical and encoding parameters at every time-step. We also design the associated switching multiscale inference methods that estimate both the unobserved regime and brain states from simultaneous spike-field activity.Main results.We validate the methods in both extensive numerical simulations and prefrontal spike-field data recorded in a monkey performing saccades for fluid rewards. We show that these methods can successfully combine the spiking and field potential observations to simultaneously track the regime and brain states accurately. Doing so, these methods lead to better state estimation compared with single-scale switching methods or stationary multiscale methods. Also, for single-scale linear Gaussian observations, the new switching smoother can better generalize to diverse system settings compared to prior switching smoothers.Significance.These modeling and inference methods effectively incorporate both regime-detection and multiscale observations. As such, they could facilitate investigation of latent switching neural population dynamics and improve future brain-machine interfaces by enabling inference in naturalistic scenarios where regime-dependent multiscale activity and behavior arise.
Collapse
Affiliation(s)
- Christian Y Song
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Han-Lin Hsieh
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Bijan Pesaran
- Departments of Neurosurgery, Neuroscience, and Bioengineering, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Maryam M Shanechi
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America.,Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, United States of America.,Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America.,Department of Computer Science, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| |
Collapse
|
50
|
Chen ZS, Kulkarni P(P, Galatzer-Levy IR, Bigio B, Nasca C, Zhang Y. Modern views of machine learning for precision psychiatry. PATTERNS (NEW YORK, N.Y.) 2022; 3:100602. [PMID: 36419447 PMCID: PMC9676543 DOI: 10.1016/j.patter.2022.100602] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
In light of the National Institute of Mental Health (NIMH)'s Research Domain Criteria (RDoC), the advent of functional neuroimaging, novel technologies and methods provide new opportunities to develop precise and personalized prognosis and diagnosis of mental disorders. Machine learning (ML) and artificial intelligence (AI) technologies are playing an increasingly critical role in the new era of precision psychiatry. Combining ML/AI with neuromodulation technologies can potentially provide explainable solutions in clinical practice and effective therapeutic treatment. Advanced wearable and mobile technologies also call for the new role of ML/AI for digital phenotyping in mobile mental health. In this review, we provide a comprehensive review of ML methodologies and applications by combining neuroimaging, neuromodulation, and advanced mobile technologies in psychiatry practice. We further review the role of ML in molecular phenotyping and cross-species biomarker identification in precision psychiatry. We also discuss explainable AI (XAI) and neuromodulation in a closed human-in-the-loop manner and highlight the ML potential in multi-media information extraction and multi-modal data fusion. Finally, we discuss conceptual and practical challenges in precision psychiatry and highlight ML opportunities in future research.
Collapse
Affiliation(s)
- Zhe Sage Chen
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
- Department of Neuroscience and Physiology, New York University Grossman School of Medicine, New York, NY 10016, USA
- The Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA
- Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, NY 11201, USA
| | | | - Isaac R. Galatzer-Levy
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
- Meta Reality Lab, New York, NY, USA
| | - Benedetta Bigio
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Carla Nasca
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
- The Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Yu Zhang
- Department of Bioengineering, Lehigh University, Bethlehem, PA 18015, USA
- Department of Electrical and Computer Engineering, Lehigh University, Bethlehem, PA 18015, USA
| |
Collapse
|