1
|
Ravan M, Noroozi A, Gediya H, James Basco K, Hasey G. Using deep learning and pretreatment EEG to predict response to sertraline, bupropion, and placebo. Clin Neurophysiol 2024; 167:198-208. [PMID: 39332081 DOI: 10.1016/j.clinph.2024.09.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 07/08/2024] [Accepted: 09/04/2024] [Indexed: 09/29/2024]
Abstract
OBJECTIVE Predicting an individual's response to antidepressant medication remains one of the most challenging tasks in the treatment of major depressive disorder (MDD). Our objective was to use the large EMBARC study database to develop an electroencephalography (EEG)-based method to predict response to antidepressant treatment. METHODS Pre-treatment EEG data were collected from study participants treated with either sertraline (N = 105), placebo (N = 119), or bupropion (N = 35). After preprocessing, the robust exact low-resolution electromagnetic tomography (ReLORETA) brain source localization method was used to reconstruct the source signals in 54 brain regions. Connectivity between regions was determined using symbolic transfer entropy (STE). A convolutional neural network (CNN) classified participants as responders or non-responders to each treatment. RESULTS Classification accuracy was 91.0%, 95.4%, and 86.8% for sertraline, placebo, and bupropion, respectively. The most highly predictive features were connectivity between i) the anterior cingulate cortex and superior parietal lobule (alpha frequency), ii) the anterior cingulate cortex and orbitofrontal area (beta frequency), and iii) the orbitofrontal area and anterior cingulate cortex (gamma frequency). CONCLUSION CNN analysis of EEG connectivity may accurately predict response to sertraline, bupropion, and placebo. SIGNIFICANCE The suggested method may offer clinicians an accessible and cost-effective tool for speedy treatment and helps pharmaceutical firms to test new antidepressants efficiently.
Collapse
Affiliation(s)
- Marman Ravan
- Department of Electrical and Computer Engineering, New York Institute of Technology, New York, NY, USA.
| | - Amin Noroozi
- School of Engineering, Computing & Mathematical Sciences, University of Wolverhampton, Wolverhampton, UK
| | - Harshil Gediya
- Department of Computer Science, New York Institute of Technology, New York, NY, USA
| | - Kennette James Basco
- Department of Computer Science, New York Institute of Technology, New York, NY, USA
| | - Gary Hasey
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, ON, Canada
| |
Collapse
|
2
|
Metin SZ, Uyulan Ç, Farhad S, Ergüzel TT, Türk Ö, Metin B, Çerezci Ö, Tarhan N. Deep Learning-Based Artificial Intelligence Can Differentiate Treatment-Resistant and Responsive Depression Cases with High Accuracy. Clin EEG Neurosci 2024:15500594241273181. [PMID: 39251228 DOI: 10.1177/15500594241273181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/11/2024]
Abstract
Background: Although there are many treatment options available for depression, a large portion of patients with depression are diagnosed with treatment-resistant depression (TRD), which is characterized by an inadequate response to antidepressant treatment. Identifying the TRD population is crucial in terms of saving time and resources in depression treatment. Recently several studies employed various methods on EEG datasets for automatic depression detection or treatment outcome prediction. However, no previous study has used the deep learning (DL) approach and EEG signals for detecting treatment resistance. Method: 77 patients with TRD, 43 patients with non-TRD, and 40 healthy controls were compared using GoogleNet convolutional neural network and DL on EEG data. Additionally, Class Activation Maps (CAMs) acquired from the TRD and non-TRD groups were used to obtain distinctive regions for classification. Results: GoogleNet classified the healthy controls and non-TRD group with 88.43%, the healthy controls and TRD subjects with 89.73%, and the TRD and non-TRD group with 90.05% accuracy. The external validation accuracy for the TRD-non-TRD classification was 73.33%. Finally, the CAM analysis revealed that the TRD group contained dominant features in class detection of deep learning architecture in almost all electrodes. Limitations: Our study is limited by the moderate sample size of clinical groups and the retrospective nature of the study. Conclusion: These findings suggest that EEG-based deep learning can be used to classify treatment resistance in depression and may in the future prove to be a useful tool in psychiatry practice to identify patients who need more vigorous intervention.
Collapse
Affiliation(s)
| | - Çağlar Uyulan
- Department of Mechanical Engineering, Katip Çelebi University, İzmir, Turkey
| | - Shams Farhad
- Department of Neuroscience, Uskudar University, Istanbul, Turkey
| | - Türker Tekin Ergüzel
- Department of Software Engineering, Faculty of Engineering and Natural Sciences, Uskudar University, Istanbul, Turkey
| | - Ömer Türk
- Department of Computer Technologies, Artuklu University, Mardin, Turkey
| | - Barış Metin
- Neurology Department, Medical Faculty, Uskudar University, Istanbul, Turkey
| | - Önder Çerezci
- Department of Physioterapy and Rehabilitation, Faculty of Health SciencesUskudar University, Istanbul, Turkey
| | - Nevzat Tarhan
- Department of Psychiatry, Uskudar University, Istanbul, Turkey
| |
Collapse
|
3
|
Mirjebreili SM, Shalbaf R, Shalbaf A. Prediction of treatment response in major depressive disorder using a hybrid of convolutional recurrent deep neural networks and effective connectivity based on EEG signal. Phys Eng Sci Med 2024; 47:633-642. [PMID: 38358619 DOI: 10.1007/s13246-024-01392-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Accepted: 01/11/2024] [Indexed: 02/16/2024]
Abstract
In this study, we have developed a novel method based on deep learning and brain effective connectivity to classify responders and non-responders to selective serotonin reuptake inhibitors (SSRIs) antidepressants in major depressive disorder (MDD) patients prior to the treatment using EEG signal. The effective connectivity of 30 MDD patients was determined by analyzing their pretreatment EEG signals, which were then concatenated into delta, theta, alpha, and beta bands and transformed into images. Using these images, we then fine tuned a hybrid Convolutional Neural Network that is enhanced with bidirectional Long Short-Term Memory cells based on transfer learning. The Inception-v3, ResNet18, DenseNet121, and EfficientNet-B0 models are implemented as base models. Finally, the models are followed by BiLSTM and dense layers in order to classify responders and non-responders to SSRI treatment. Results showed that the EfficiencyNet-B0 has the highest accuracy of 98.33, followed by DensNet121, ResNet18 and Inception-v3. Therefore, a new method was proposed in this study that uses deep learning models to extract both spatial and temporal features automatically, which will improve classification results. The proposed method provides accurate identification of MDD patients who are responding, thereby reducing the cost of medical facilities and patient care.
Collapse
Affiliation(s)
| | - Reza Shalbaf
- Institute for Cognitive Science Studies, Tehran, Iran
| | - Ahmad Shalbaf
- Department of Biomedical Engineering and Medical Physics, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
4
|
Grabowska A, Zabielski J, Senderecka M. Machine learning reveals differential effects of depression and anxiety on reward and punishment processing. Sci Rep 2024; 14:8422. [PMID: 38600089 PMCID: PMC11366008 DOI: 10.1038/s41598-024-58031-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Accepted: 03/25/2024] [Indexed: 04/12/2024] Open
Abstract
Recent studies suggest that depression and anxiety are associated with unique aspects of EEG responses to reward and punishment, respectively; also, abnormal responses to punishment in depressed individuals are related to anxiety, the symptoms of which are comorbid with depression. In a non-clinical sample, we aimed to investigate the relationships between reward processing and anxiety, between punishment processing and anxiety, between reward processing and depression, and between punishment processing and depression. Towards this aim, we separated feedback-related brain activity into delta and theta bands to isolate activity that indexes functionally distinct processes. Based on the delta/theta frequency and feedback valence, we then used machine learning (ML) to classify individuals with high severity of depressive symptoms and individuals with high severity of anxiety symptoms versus controls. The significant difference between the depression and control groups was driven mainly by delta activity; there were no differences between reward- and punishment-theta activities. The high severity of anxiety symptoms was marginally more strongly associated with the punishment- than the reward-theta feedback processing. The findings provide new insights into the differences in the impacts of anxiety and depression on reward and punishment processing; our study shows the utility of ML in testing brain-behavior hypotheses and emphasizes the joint effect of theta-RewP/FRN and delta frequency on feedback-related brain activity.
Collapse
Affiliation(s)
- Anna Grabowska
- Doctoral School in the Social Sciences, Jagiellonian University, Main Square 34, 30-010, Kraków, Poland.
- Institute of Philosophy, Jagiellonian University, Grodzka 52, 31-044, Kraków, Poland.
| | - Jakub Zabielski
- Institute of Philosophy, Jagiellonian University, Grodzka 52, 31-044, Kraków, Poland
| | - Magdalena Senderecka
- Institute of Philosophy, Jagiellonian University, Grodzka 52, 31-044, Kraków, Poland.
| |
Collapse
|
5
|
van der Wijk G, Enkhbold Y, Cnudde K, Szostakiwskyj MW, Blier P, Knott V, Jaworska N, Protzner AB. One size does not fit all: notable individual variation in brain activity correlates of antidepressant treatment response. Front Psychiatry 2024; 15:1358018. [PMID: 38628260 PMCID: PMC11018891 DOI: 10.3389/fpsyt.2024.1358018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Accepted: 03/18/2024] [Indexed: 04/19/2024] Open
Abstract
Introduction To date, no robust electroencephalography (EEG) markers of antidepressant treatment response have been identified. Variable findings may arise from the use of group analyses, which neglect individual variation. Using a combination of group and single-participant analyses, we explored individual variability in EEG characteristics of treatment response. Methods Resting-state EEG data and Montgomery-Åsberg Depression Rating Scale (MADRS) symptom scores were collected from 43 patients with depression before, at 1 and 12 weeks of pharmacotherapy. Partial least squares (PLS) was used to: 1) identify group differences in EEG connectivity (weighted phase lag index) and complexity (multiscale entropy) between eventual medication responders and non-responders, and 2) determine whether group patterns could be identified in individual patients. Results Responders showed decreased alpha and increased beta connectivity, and early, widespread decreases in complexity over treatment. Non-responders showed an opposite connectivity pattern, and later, spatially confined decreases in complexity. Thus, as in previous studies, our group analyses identified significant differences between groups of patients with different treatment outcomes. These group-level EEG characteristics were only identified in ~40-60% of individual patients, as assessed quantitatively by correlating the spatiotemporal brain patterns between groups and individual results, and by independent raters through visualization. Discussion Our single-participant analyses suggest that substantial individual variation exists, and needs to be considered when investigating characteristics of antidepressant treatment response for potential clinical applicability. Clinical trial registration https://clinicaltrials.gov, identifier NCT00519428.
Collapse
Affiliation(s)
- Gwen van der Wijk
- Department of Psychology, University of Calgary, Calgary, AB, Canada
| | - Yaruuna Enkhbold
- Department of Psychology, University of Calgary, Calgary, AB, Canada
| | - Kelsey Cnudde
- Department of Psychology, University of Calgary, Calgary, AB, Canada
| | | | - Pierre Blier
- Institute of Mental Health Research, Affiliated with the University of Ottawa, Ottawa, ON, Canada
- Department of Cellular & Molecular Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Verner Knott
- Institute of Mental Health Research, Affiliated with the University of Ottawa, Ottawa, ON, Canada
- Department of Cellular & Molecular Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Natalia Jaworska
- Institute of Mental Health Research, Affiliated with the University of Ottawa, Ottawa, ON, Canada
- Department of Cellular & Molecular Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Andrea B. Protzner
- Department of Psychology, University of Calgary, Calgary, AB, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
- Mathison Centre, University of Calgary, Calgary, AB, Canada
| |
Collapse
|
6
|
Kilshaw RE, Boggins A, Everett O, Butner E, Leifker FR, Baucom BRW. Benchmarking Mental Health Status Using Passive Sensor Data: Protocol for a Prospective Observational Study. JMIR Res Protoc 2024; 13:e53857. [PMID: 38536220 PMCID: PMC11007613 DOI: 10.2196/53857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 01/27/2024] [Accepted: 02/22/2024] [Indexed: 04/13/2024] Open
Abstract
BACKGROUND Computational psychiatry has the potential to advance the diagnosis, mechanistic understanding, and treatment of mental health conditions. Promising results from clinical samples have led to calls to extend these methods to mental health risk assessment in the general public; however, data typically used with clinical samples are neither available nor scalable for research in the general population. Digital phenotyping addresses this by capitalizing on the multimodal and widely available data created by sensors embedded in personal digital devices (eg, smartphones) and is a promising approach to extending computational psychiatry methods to improve mental health risk assessment in the general population. OBJECTIVE Building on recommendations from existing computational psychiatry and digital phenotyping work, we aim to create the first computational psychiatry data set that is tailored to studying mental health risk in the general population; includes multimodal, sensor-based behavioral features; and is designed to be widely shared across academia, industry, and government using gold standard methods for privacy, confidentiality, and data integrity. METHODS We are using a stratified, random sampling design with 2 crossed factors (difficulties with emotion regulation and perceived life stress) to recruit a sample of 400 community-dwelling adults balanced across high- and low-risk for episodic mental health conditions. Participants first complete self-report questionnaires assessing current and lifetime psychiatric and medical diagnoses and treatment, and current psychosocial functioning. Participants then complete a 7-day in situ data collection phase that includes providing daily audio recordings, passive sensor data collected from smartphones, self-reports of daily mood and significant events, and a verbal description of the significant daily events during a nightly phone call. Participants complete the same baseline questionnaires 6 and 12 months after this phase. Self-report questionnaires will be scored using standard methods. Raw audio and passive sensor data will be processed to create a suite of daily summary features (eg, time spent at home). RESULTS Data collection began in June 2022 and is expected to conclude by July 2024. To date, 310 participants have consented to the study; 149 have completed the baseline questionnaire and 7-day intensive data collection phase; and 61 and 31 have completed the 6- and 12-month follow-up questionnaires, respectively. Once completed, the proposed data set will be made available to academic researchers, industry, and the government using a stepped approach to maximize data privacy. CONCLUSIONS This data set is designed as a complementary approach to current computational psychiatry and digital phenotyping research, with the goal of advancing mental health risk assessment within the general population. This data set aims to support the field's move away from siloed research laboratories collecting proprietary data and toward interdisciplinary collaborations that incorporate clinical, technical, and quantitative expertise at all stages of the research process. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/53857.
Collapse
Affiliation(s)
- Robyn E Kilshaw
- Department of Psychology, University of Utah, Salt Lake City, UT, United States
| | - Abigail Boggins
- Department of Psychology, University of Utah, Salt Lake City, UT, United States
| | - Olivia Everett
- Department of Psychology, University of Utah, Salt Lake City, UT, United States
| | - Emma Butner
- Department of Psychology, University of Utah, Salt Lake City, UT, United States
| | - Feea R Leifker
- Department of Psychology, University of Utah, Salt Lake City, UT, United States
| | - Brian R W Baucom
- Department of Psychology, University of Utah, Salt Lake City, UT, United States
| |
Collapse
|
7
|
Godfrey K, Muthukumaraswamy SD, Stinear CM, Hoeh NR. Resting-state EEG connectivity recorded before and after rTMS treatment in patients with treatment-resistant depression. Psychiatry Res Neuroimaging 2024; 338:111767. [PMID: 38183848 DOI: 10.1016/j.pscychresns.2023.111767] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 11/12/2023] [Accepted: 12/08/2023] [Indexed: 01/08/2024]
Abstract
Repetitive transcranial magnetic stimulation (rTMS) has shown efficacy and tolerability in Major Depressive Disorder (MDD). However, the underlying mechanisms of its antidepressant effects remain unclear. This open-label study investigated electroencephalography (EEG) functional connectivity markers associated with response and the antidepressant effects of rTMS. Resting-state EEG data were collected from 28 participants with MDD before and after a four-week rTMS course. Source-space functional connectivity between 38 cortical regions was compared using an orthogonalised amplitude approach. Depressive symptoms significantly improved following rTMS, with 43 % of participants classified as responders. While the study's functional connectivity findings did not withstand multiple comparison corrections, exploratory analyses suggest an association between theta band connectivity and rTMS treatment mechanisms. Fronto-parietal theta connectivity increased after treatment but did not correlate with antidepressant response. Notably, low baseline theta connectivity was associated with greater response. However, due to the exploratory nature and small sample size, further replication is needed. The findings provide preliminary evidence that EEG functional connectivity, particularly within the theta band, may reflect the mechanisms by which rTMS exerts its therapeutic effects.
Collapse
Affiliation(s)
- Kate Godfrey
- School of Pharmacy, The University of Auckland, Auckland, New Zealand; Division of Psychiatry, Imperial College London, London, United Kingdom.
| | | | - Cathy M Stinear
- School of Medicine, The University of Auckland, Auckland, New Zealand
| | - Nicholas R Hoeh
- Department of Psychological Medicine, The University of Auckland, Auckland, New Zealand; Auckland District Health Board, Auckland, New Zealand
| |
Collapse
|
8
|
Choi J, Kim K, Park SH, Hur J, Yang H, Kim YH, Lee H, Han S. Investigation of factors regarding the effects of COVID-19 pandemic on college students' depression by quantum annealer. Sci Rep 2024; 14:4684. [PMID: 38409195 PMCID: PMC11306746 DOI: 10.1038/s41598-024-54533-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Accepted: 02/13/2024] [Indexed: 02/28/2024] Open
Abstract
Diverse cases regarding the impact, with its related factors, of the COVID-19 pandemic on mental health have been reported in previous studies. In this study, multivariable datasets were collected from 751 college students who could be easily affected by pandemics based on the complex relationships between various mental health factors. We utilized quantum annealing (QA)-based feature selection algorithms that were executed by commercial D-Wave quantum computers to determine the changes in the relative importance of the associated factors before and after the pandemic. Multivariable linear regression (MLR) and XGBoost models were also applied to validate the QA-based algorithms. Based on the experimental results, we confirm that QA-based algorithms have comparable capabilities in factor analysis research to the MLR models that have been widely used in previous studies. Furthermore, the performance of the QA-based algorithms was validated through the important factor results from the algorithms. Pandemic-related factors (e.g., confidence in the social system) and psychological factors (e.g. decision-making in uncertain situations) were more important in post-pandemic conditions. Although the results should be validated using other mental health variables or national datasets, this study will serve as a reference for researchers regarding the use of the quantum annealing approach in factor analysis with validation through real-world survey dataset analysis.
Collapse
Affiliation(s)
- Junggu Choi
- Yonsei Graduate program in Cognitive Science, Yonsei University, Seoul, 03722, Republic of Korea
| | - Kion Kim
- Korea Quantum Computing©, Seoul, 06164, Republic of Korea
| | - Soo Hyun Park
- Department of Psychology, Yonsei University, Seoul, 03722, Republic of Korea
| | - Juyoen Hur
- Department of Psychology, Yonsei University, Seoul, 03722, Republic of Korea
| | - Hyunjung Yang
- University College, Yonsei University, Seoul, 03722, Republic of Korea
| | - Young-Hoon Kim
- Department of Psychology, Yonsei University, Seoul, 03722, Republic of Korea
| | - Hakbae Lee
- Deparment of Applied Statistics, Yonsei University, Seoul, 03722, Republic of Korea
- Department of Statistics and Data Science, Yonsei University, Seoul, 03722, Republic of Korea
| | - Sanghoon Han
- Yonsei Graduate program in Cognitive Science, Yonsei University, Seoul, 03722, Republic of Korea.
- Department of Psychology, Yonsei University, Seoul, 03722, Republic of Korea.
| |
Collapse
|
9
|
Schwartzmann B, Dhami P, Uher R, Lam RW, Frey BN, Milev R, Müller DJ, Blier P, Soares CN, Parikh SV, Turecki G, Foster JA, Rotzinger S, Kennedy SH, Farzan F. Developing an Electroencephalography-Based Model for Predicting Response to Antidepressant Medication. JAMA Netw Open 2023; 6:e2336094. [PMID: 37768659 PMCID: PMC10539986 DOI: 10.1001/jamanetworkopen.2023.36094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/29/2023] Open
Abstract
Importance Untreated depression is a growing public health concern, with patients often facing a prolonged trial-and-error process in search of effective treatment. Developing a predictive model for treatment response in clinical practice remains challenging. Objective To establish a model based on electroencephalography (EEG) to predict response to 2 distinct selective serotonin reuptake inhibitor (SSRI) medications. Design, Setting, and Participants This prognostic study developed a predictive model using EEG data collected between 2011 and 2017 from 2 independent cohorts of participants with depression: 1 from the first Canadian Biomarker Integration Network in Depression (CAN-BIND) group and the other from the Establishing Moderators and Biosignatures of Antidepressant Response for Clinical Care (EMBARC) consortium. Eligible participants included those aged 18 to 65 years who had a diagnosis of major depressive disorder. Data were analyzed from January to December 2022. Exposures In an open-label trial, CAN-BIND participants received an 8-week treatment regimen of escitalopram treatment (10-20 mg), and EMBARC participants were randomized in a double-blind trial to receive an 8-week sertraline (50-200 mg) treatment or placebo treatment. Main Outcomes and Measures The model's performance was estimated using balanced accuracy, specificity, and sensitivity metrics. The model used data from the CAN-BIND cohort for internal validation, and data from the treatment group of the EMBARC cohort for external validation. At week 8, response to treatment was defined as a 50% or greater reduction in the primary, clinician-rated scale of depression severity. Results The CAN-BIND cohort included 125 participants (mean [SD] age, 36.4 [13.0] years; 78 [62.4%] women), and the EMBARC sertraline treatment group included 105 participants (mean [SD] age, 38.4 [13.8] years; 72 [68.6%] women). The model achieved a balanced accuracy of 64.2% (95% CI, 55.8%-72.6%), sensitivity of 66.1% (95% CI, 53.7%-78.5%), and specificity of 62.3% (95% CI, 50.1%-73.8%) during internal validation with CAN-BIND. During external validation with EMBARC, the model achieved a balanced accuracy of 63.7% (95% CI, 54.5%-72.8%), sensitivity of 58.8% (95% CI, 45.3%-72.3%), and specificity of 68.5% (95% CI, 56.1%-80.9%). Additionally, the balanced accuracy for the EMBARC placebo group (118 participants) was 48.7% (95% CI, 39.3%-58.0%), the sensitivity was 50.0% (95% CI, 35.2%-64.8%), and the specificity was 47.3% (95% CI, 35.9%-58.7%), suggesting the model's specificity in predicting SSRIs treatment response. Conclusions and Relevance In this prognostic study, an EEG-based model was developed and validated in 2 independent cohorts. The model showed promising accuracy in predicting treatment response to 2 distinct SSRIs, suggesting potential applications for personalized depression treatment.
Collapse
Affiliation(s)
- Benjamin Schwartzmann
- eBrain Lab, School of Mechatronic Systems Engineering, Simon Fraser University, Surrey, British Columbia, Canada
| | - Prabhjot Dhami
- eBrain Lab, School of Mechatronic Systems Engineering, Simon Fraser University, Surrey, British Columbia, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Centre for Addiction and Mental Health, Toronto, Ontario, Canada
| | - Rudolf Uher
- Department of Psyciatry, Dalhousie University, Halifax, Nova Scotia, Canada
| | - Raymond W Lam
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada
| | - Benicio N Frey
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
- Mood Disorders Program and Women's Health Concerns Clinic, St. Joseph's Healthcare, Hamilton, Ontario, Canada
| | - Roumen Milev
- Department of Psychiatry, Queen's University, Providence Care, Kingston, Ontario, Canada
- Department of Psychology, Queen's University, Providence Care, Kingston, Ontario, Canada
| | - Daniel J Müller
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Centre for Addiction and Mental Health, Toronto, Ontario, Canada
| | - Pierre Blier
- Mood Disorders Research Unit, University of Ottawa Institute of Mental Health Research, Ottawa, Ontario, Canada
| | - Claudio N Soares
- Department of Psychiatry, Queen's University, Providence Care, Kingston, Ontario, Canada
- Department of Psychology, Queen's University, Providence Care, Kingston, Ontario, Canada
| | | | - Gustavo Turecki
- Douglas Mental Health University Institute, Department of Psychiatry, McGill University, Montreal, Quebec, Canada
| | - Jane A Foster
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
- Center for Depression Research and Clinical Care, University of Texas Southwestern Medical Center, Dallas
| | - Susan Rotzinger
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Mood Disorders Program and Women's Health Concerns Clinic, St. Joseph's Healthcare, Hamilton, Ontario, Canada
| | - Sidney H Kennedy
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Unity Health Toronto, Toronto, Ontario, Canada
| | - Faranak Farzan
- eBrain Lab, School of Mechatronic Systems Engineering, Simon Fraser University, Surrey, British Columbia, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Centre for Addiction and Mental Health, Toronto, Ontario, Canada
| |
Collapse
|
10
|
Nicolini ME, Jardas EJ, Zarate CA, Gastmans C, Kim SYH. Irremediability in psychiatric euthanasia: examining the objective standard. Psychol Med 2023; 53:5729-5747. [PMID: 36305567 PMCID: PMC10482705 DOI: 10.1017/s0033291722002951] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 08/22/2022] [Accepted: 08/31/2022] [Indexed: 11/06/2022]
Abstract
BACKGROUND Irremediability is a key requirement for euthanasia and assisted suicide for psychiatric disorders (psychiatric EAS). Countries like the Netherlands and Belgium ask clinicians to assess irremediability in light of the patient's diagnosis and prognosis and 'according to current medical understanding'. Clarifying the relevance of a default objective standard for irremediability when applied to psychiatric EAS is crucial for solid policymaking. Yet so far, a thorough examination of this standard is lacking. METHODS Using treatment-resistant depression (TRD) as a test case, through a scoping review in PubMed, we analyzed the state-of-the-art evidence for whether clinicians can accurately predict individual long-term outcome and single out irremediable cases, by examining the following questions: (1) What is the definition of TRD; (2) What are group-level long-term outcomes of TRD; and (3) Can clinicians make accurate individual outcome predictions in TRD? RESULTS A uniform definition of TRD is lacking, with over 150 existing definitions, mostly focused on psychopharmacological research. Available yet limited studies about long-term outcomes indicate that a majority of patients with long-term TRD show significant improvement over time. Finally, evidence about individual predictions in TRD using precision medicine is growing, but methodological shortcomings and varying predictive accuracies pose important challenges for its implementation in clinical practice. CONCLUSION Our findings support the claim that, as per available evidence, clinicians cannot accurately predict long-term chances of recovery in a particular patient with TRD. This means that the objective standard for irremediability cannot be met, with implications for policy and practice of psychiatric EAS.
Collapse
Affiliation(s)
- Marie E Nicolini
- Department of Bioethics, National Institutes of Health, 10 Center Drive, Room 1C118, Bethesda, Maryland 20892, USA
- Center for Biomedical Ethics and Law, KU Leuven, Kapucijnenvoer 35 - Box 7001, 3000 Leuven, Belgium
| | - E J Jardas
- Department of Bioethics, National Institutes of Health, 10 Center Drive, Room 1C118, Bethesda, Maryland 20892, USA
| | - Carlos A Zarate
- Section on the Neurobiology and Treatment of Mood Disorders, Experimental Therapeutics and Pathophysiology Branch, National Institutes of Mental Health, 6001 Executive Boulevard, Room 6200, MSC 9663, Bethesda, MD 20892, USA
| | - Chris Gastmans
- Center for Biomedical Ethics and Law, KU Leuven, Kapucijnenvoer 35 - Box 7001, 3000 Leuven, Belgium
| | - Scott Y H Kim
- Department of Bioethics, National Institutes of Health, 10 Center Drive, Room 1C118, Bethesda, Maryland 20892, USA
| |
Collapse
|
11
|
Pacia SV. Sub-Scalp Implantable Telemetric EEG (SITE) for the Management of Neurological and Behavioral Disorders beyond Epilepsy. Brain Sci 2023; 13:1176. [PMID: 37626532 PMCID: PMC10452821 DOI: 10.3390/brainsci13081176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 08/01/2023] [Accepted: 08/03/2023] [Indexed: 08/27/2023] Open
Abstract
Sub-scalp Implantable Telemetric EEG (SITE) devices are under development for the treatment of epilepsy. However, beyond epilepsy, continuous EEG analysis could revolutionize the management of patients suffering from all types of brain disorders. This article reviews decades of foundational EEG research, collected from short-term routine EEG studies of common neurological and behavioral disorders, that may guide future SITE management and research. Established quantitative EEG methods, like spectral EEG power density calculation combined with state-of-the-art machine learning techniques applied to SITE data, can identify new EEG biomarkers of neurological disease. From distinguishing syncopal events from seizures to predicting the risk of dementia, SITE-derived EEG biomarkers can provide clinicians with real-time information about diagnosis, treatment response, and disease progression.
Collapse
Affiliation(s)
- Steven V Pacia
- Zucker School of Medicine at Hofstra-Northwell, Neurology Northwell Health, 611 Northern Blvd, Great Neck, New York, NY 11021, USA
| |
Collapse
|
12
|
Merritt SH, Gaffuri K, Zak PJ. Accurately predicting hit songs using neurophysiology and machine learning. Front Artif Intell 2023; 6:1154663. [PMID: 37408542 PMCID: PMC10318137 DOI: 10.3389/frai.2023.1154663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Accepted: 05/09/2023] [Indexed: 07/07/2023] Open
Abstract
Identifying hit songs is notoriously difficult. Traditionally, song elements have been measured from large databases to identify the lyrical aspects of hits. We took a different methodological approach, measuring neurophysiologic responses to a set of songs provided by a streaming music service that identified hits and flops. We compared several statistical approaches to examine the predictive accuracy of each technique. A linear statistical model using two neural measures identified hits with 69% accuracy. Then, we created a synthetic set data and applied ensemble machine learning to capture inherent non-linearities in neural data. This model classified hit songs with 97% accuracy. Applying machine learning to the neural response to 1st min of songs accurately classified hits 82% of the time showing that the brain rapidly identifies hit music. Our results demonstrate that applying machine learning to neural data can substantially increase classification accuracy for difficult to predict market outcomes.
Collapse
Affiliation(s)
- Sean H. Merritt
- Center for Neuroeconomics Studies, Claremont Graduate University, Claremont, CA, United States
| | - Kevin Gaffuri
- Center for Neuroeconomics Studies, Claremont Graduate University, Claremont, CA, United States
| | - Paul J. Zak
- Center for Neuroeconomics Studies, Claremont Graduate University, Claremont, CA, United States
- Immersion Neuroscience, Henderson, NV, United States
| |
Collapse
|
13
|
Squires M, Tao X, Elangovan S, Gururajan R, Zhou X, Acharya UR, Li Y. Deep learning and machine learning in psychiatry: a survey of current progress in depression detection, diagnosis and treatment. Brain Inform 2023; 10:10. [PMID: 37093301 PMCID: PMC10123592 DOI: 10.1186/s40708-023-00188-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2022] [Accepted: 03/08/2023] [Indexed: 04/25/2023] Open
Abstract
Informatics paradigms for brain and mental health research have seen significant advances in recent years. These developments can largely be attributed to the emergence of new technologies such as machine learning, deep learning, and artificial intelligence. Data-driven methods have the potential to support mental health care by providing more precise and personalised approaches to detection, diagnosis, and treatment of depression. In particular, precision psychiatry is an emerging field that utilises advanced computational techniques to achieve a more individualised approach to mental health care. This survey provides an overview of the ways in which artificial intelligence is currently being used to support precision psychiatry. Advanced algorithms are being used to support all phases of the treatment cycle. These systems have the potential to identify individuals suffering from mental health conditions, allowing them to receive the care they need and tailor treatments to individual patients who are mostly to benefit. Additionally, unsupervised learning techniques are breaking down existing discrete diagnostic categories and highlighting the vast disease heterogeneity observed within depression diagnoses. Artificial intelligence also provides the opportunity to shift towards evidence-based treatment prescription, moving away from existing methods based on group averages. However, our analysis suggests there are several limitations currently inhibiting the progress of data-driven paradigms in care. Significantly, none of the surveyed articles demonstrate empirically improved patient outcomes over existing methods. Furthermore, greater consideration needs to be given to uncertainty quantification, model validation, constructing interdisciplinary teams of researchers, improved access to diverse data and standardised definitions within the field. Empirical validation of computer algorithms via randomised control trials which demonstrate measurable improvement to patient outcomes are the next step in progressing models to clinical implementation.
Collapse
Affiliation(s)
- Matthew Squires
- School of Mathematics, Physics and Computing, University of Southern Queensland, Toowoomba, QLD, Australia.
| | - Xiaohui Tao
- School of Mathematics, Physics and Computing, University of Southern Queensland, Toowoomba, QLD, Australia
| | | | - Raj Gururajan
- School of Business, University of Southern Queensland, Springfield, QLD, Australia
| | - Xujuan Zhou
- School of Business, University of Southern Queensland, Springfield, QLD, Australia
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Toowoomba, QLD, Australia
| | - Yuefeng Li
- School of Computer Science, Queensland University of Technology, Brisbane, QLD, Australia
| |
Collapse
|
14
|
Ebrahimzadeh E, Fayaz F, Rajabion L, Seraji M, Aflaki F, Hammoud A, Taghizadeh Z, Asgarinejad M, Soltanian-Zadeh H. Machine learning approaches and non-linear processing of extracted components in frontal region to predict rTMS treatment response in major depressive disorder. Front Syst Neurosci 2023; 17:919977. [PMID: 36968455 PMCID: PMC10034109 DOI: 10.3389/fnsys.2023.919977] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Accepted: 02/13/2023] [Indexed: 03/12/2023] Open
Abstract
Predicting the therapeutic result of repetitive transcranial magnetic stimulation (rTMS) treatment could save time and costs as ineffective treatment can be avoided. To this end, we presented a machine-learning-based strategy for classifying patients with major depression disorder (MDD) into responders (R) and nonresponders (NR) to rTMS treatment. Resting state EEG data were recorded using 32 electrodes from 88 MDD patients before treatment. Then, patients underwent 7 weeks of rTMS, and 46 of them responded to treatment. By applying Independent Component Analysis (ICA) on EEG, we identified the relevant brain sources as possible indicators of neural activity in the dorsolateral prefrontal cortex (DLPFC). This was served through estimating the generators of activity in the sensor domain. Subsequently, we added physiological information and placed certain terms and conditions to offer a far more realistic estimation than the classic EEG. Ultimately, those components mapped in accordance with the region of the DLPFC in the sensor domain were chosen. Features extracted from the relevant ICs time series included permutation entropy (PE), fractal dimension (FD), Lempel-Ziv Complexity (LZC), power spectral density, correlation dimension (CD), features based on bispectrum, frontal and prefrontal cordance, and a combination of them. The most relevant features were selected by a Genetic Algorithm (GA). For classifying two groups of R and NR, K-Nearest Neighbor (KNN), Support Vector Machine (SVM), and Multilayer Perceptron (MLP) were applied to predict rTMS treatment response. To evaluate the performance of classifiers, a 10-fold cross-validation method was employed. A statistical test was used to assess the capability of features in differentiating R and NR for further research. EEG characteristics that can predict rTMS treatment response were discovered. The strongest discriminative indicators were EEG beta power, the sum of bispectrum diagonal elements in delta and beta bands, and CD. The Combined feature vector classified R and NR with a high performance of 94.31% accuracy, 92.85% specificity, 95.65% sensitivity, and 92.85% precision using SVM. This result indicates that our proposed method with power and nonlinear and bispectral features from relevant ICs time-series can predict the treatment outcome of rTMS for MDD patients only by one session pretreatment EEG recording. The obtained results show that the proposed method outperforms previous methods.
Collapse
Affiliation(s)
- Elias Ebrahimzadeh
- School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
- *Correspondence: Elias Ebrahimzadeh
| | - Farahnaz Fayaz
- Biomedical Engineering Department, School of Electrical Engineering, Payame Noor University of North Tehran, Tehran, Iran
| | - Lila Rajabion
- School of Graduate Studies, SUNY Empire State College, Manhattan, NY, United States
| | - Masoud Seraji
- Department of Psychology, University of Texas at Austin, Austin, TX, United States
| | - Fatemeh Aflaki
- Department of Biomedical Engineering, Islamic Azad University Central Tehran Branch, Tehran, Iran
| | - Ahmad Hammoud
- Department of Medical and Technical Information Technology, Bauman Moscow State Technical University, Moscow, Russia
| | - Zahra Taghizadeh
- Department of Bioengineering, George Mason University, Fairfax, VA, United States
| | - Mostafa Asgarinejad
- Department of Cognitive Neuroscience, Institute for Cognitive Sciences Studies, Tehran, Iran
| | - Hamid Soltanian-Zadeh
- School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
| |
Collapse
|
15
|
van Dijk H, Koppenberg M, Arns M. Towards Robust, Reproducible, and Clinically Actionable EEG Biomarkers: Large Open Access EEG Database for Discovery and Out-of-sample Validation. Clin EEG Neurosci 2023; 54:103-105. [PMID: 35975621 DOI: 10.1177/15500594221120516] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Affiliation(s)
- Hanneke van Dijk
- Research Institute Brainclinics, Brainclinics Foundation, Nijmegen, the Netherlands.,Faculty of Psychology & Neuroscience, Department of Cognitive Neuroscience, Maastricht University, Maastricht, the Netherlands
| | - Mark Koppenberg
- Research Institute Brainclinics, Brainclinics Foundation, Nijmegen, the Netherlands
| | - Martijn Arns
- Research Institute Brainclinics, Brainclinics Foundation, Nijmegen, the Netherlands.,Faculty of Psychology & Neuroscience, Department of Cognitive Neuroscience, Maastricht University, Maastricht, the Netherlands
| |
Collapse
|
16
|
Castro Martínez JC, Santamaría-García H. Understanding mental health through computers: An introduction to computational psychiatry. Front Psychiatry 2023; 14:1092471. [PMID: 36824671 PMCID: PMC9941647 DOI: 10.3389/fpsyt.2023.1092471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Accepted: 01/16/2023] [Indexed: 02/10/2023] Open
Abstract
Computational psychiatry recently established itself as a new tool in the study of mental disorders and problems. Integration of different levels of analysis is creating computational phenotypes with clinical and research values, and constructing a way to arrive at precision psychiatry are part of this new branch. It conceptualizes the brain as a computational organ that receives from the environment parameters to respond to challenges through calculations and algorithms in continuous feedback and feedforward loops with a permanent degree of uncertainty. Through this conception, one can seize an understanding of the cerebral and mental processes in the form of theories or hypotheses based on data. Using these approximations, a better understanding of the disorder and its different determinant factors facilitates the diagnostics and treatment by having an individual, ecologic, and holistic approach. It is a tool that can be used to homologate and integrate multiple sources of information given by several theoretical models. In conclusion, it helps psychiatry achieve precision and reproducibility, which can help the mental health field achieve significant advancement. This article is a narrative review of the basis of the functioning of computational psychiatry with a critical analysis of its concepts.
Collapse
Affiliation(s)
- Juan Camilo Castro Martínez
- Departamento de Psiquiatría y Salud Mental, Facultad de Medicina, Pontificia Universidad Javeriana, Bogotá, Colombia
| | - Hernando Santamaría-García
- Ph.D. Programa de Neurociencias, Departamento de Psiquiatría y Salud Mental, Pontificia Universidad Javeriana, Bogotá, Colombia
- Centro de Memoria y Cognición Intellectus, Hospital Universitario San Ignacio, Bogotá, Colombia
- Global Brain Health Institute, University of California, San Francisco – Trinity College Dublin, San Francisco, CA, United States
| |
Collapse
|
17
|
Ziogas A, Habermeyer E, Santtila P, Poeppl TB, Mokros A. Neuroelectric Correlates of Human Sexuality: A Review and Meta-Analysis. ARCHIVES OF SEXUAL BEHAVIOR 2023; 52:497-596. [PMID: 32016814 DOI: 10.1007/s10508-019-01547-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2018] [Revised: 07/17/2019] [Accepted: 09/04/2019] [Indexed: 05/15/2023]
Abstract
Many reviews on sexual arousal in humans focus on different brain imaging methods and behavioral observations. Although neurotransmission in the brain is mainly performed through electrochemical signals, there are no systematic reviews of the electrophysiological correlates of sexual arousal. We performed a systematic search on this subject and reviewed 255 studies including various electrophysiological methods. Our results show how neuroelectric signals have been used to investigate genital somatotopy as well as basic genital physiology during sexual arousal and how cortical electric signals have been recorded during orgasm. Moreover, experiments on the interactions of cognition and sexual arousal in healthy subjects and in individuals with abnormal sexual preferences were analyzed as well as case studies on sexual disturbances associated with diseases of the nervous system. In addition, 25 studies focusing on brain potentials during the interaction of cognition and sexual arousal were eligible for meta-analysis. The results showed significant effect sizes for specific brain potentials during sexual stimulation (P3: Cohen's d = 1.82, N = 300, LPP: Cohen's d = 2.30, N = 510) with high heterogeneity between the combined studies. Taken together, our review shows how neuroelectric methods can consistently differentiate sexual arousal from other emotional states.
Collapse
Affiliation(s)
- Anastasios Ziogas
- Department of Forensic Psychiatry, University Hospital of Psychiatry Zurich, Alleestrasse 61A, 8462, Rheinau, Switzerland.
| | - Elmar Habermeyer
- Department of Forensic Psychiatry, University Hospital of Psychiatry Zurich, Zurich, Switzerland
| | - Pekka Santtila
- Department of Arts & Sciences, New York University-Shanghai, Shanghai, China
| | - Timm B Poeppl
- Department of Psychiatry, Psychotherapy and Psychosomatic Medicine, RWTH Aachen University, Aachen, Germany
| | - Andreas Mokros
- Department of Forensic Psychiatry, University Hospital of Psychiatry Zurich, Zurich, Switzerland
- Faculty of Psychology, Fern Universität in Hagen (University of Hagen), Hagen, Germany
| |
Collapse
|
18
|
Cohen SE, Zantvoord JB, Wezenberg BN, Daams JG, Bockting CLH, Denys D, van Wingen GA. Electroencephalography for predicting antidepressant treatment success: A systematic review and meta-analysis. J Affect Disord 2023; 321:201-207. [PMID: 36341804 DOI: 10.1016/j.jad.2022.10.042] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Revised: 10/19/2022] [Accepted: 10/22/2022] [Indexed: 11/06/2022]
Abstract
BACKGROUND Patients suffering from major depressive disorder (MDD) regularly experience non-response to treatment for their depressive episode. Personalized clinical decision making could shorten depressive episodes and reduce patient suffering. Although no clinical tools are currently available, machine learning analysis of electroencephalography (EEG) shows promise in treatment response prediction. METHODS With a systematic review and meta-analysis, we evaluated the accuracy of EEG for individual patient response prediction. Importantly, we included only prediction studies that used cross-validation. We used a bivariate model to calculate prediction success, as expressed by area-under the curve, sensitivity and specificity. Furthermore, we analyzed prediction success for separate antidepressant interventions. RESULTS 15 studies with 12 individual patient samples and a total of 479 patients were included. Research methods varied considerably between studies. Meta-analysis of results from this heterogeneous set of studies resulted in an area under the curve of 0.91, a sensitivity of 83 % (95 % CI 74-89 %), and a specificity of 86 % (95 % CI 81-90 %). Classification performance did not significantly differ between treatments. Although studies were all internally validated, no externally validated studies have been reported. We found substantial risk of bias caused by methodological shortcomings such as non-independent feature selection, though performance of non-biased studies was comparable. LIMITATIONS Sample sizes were relatively small and no study used external validation, increasing the risk of overestimation of accuracy. CONCLUSIONS Electroencephalography can predict the response to antidepressant treatment with high accuracy. However, future studies with more rigorous validation are needed to produce a clinical tool to guide interventions in MDD. PROSPERO REGISTRATION NUMBER CRD42021268169.
Collapse
Affiliation(s)
- S E Cohen
- Amsterdam UMC location University of Amsterdam, Department of Psychiatry, Meibergdreef 9, Amsterdam, Netherlands; Amsterdam Neuroscience, Amsterdam, the Netherlands
| | - J B Zantvoord
- Amsterdam UMC location University of Amsterdam, Department of Psychiatry, Meibergdreef 9, Amsterdam, Netherlands; Amsterdam Neuroscience, Amsterdam, the Netherlands
| | - B N Wezenberg
- Amsterdam UMC location University of Amsterdam, Department of Psychiatry, Meibergdreef 9, Amsterdam, Netherlands; Amsterdam Neuroscience, Amsterdam, the Netherlands
| | - J G Daams
- Amsterdam UMC location University of Amsterdam, Department of Psychiatry, Meibergdreef 9, Amsterdam, Netherlands; Amsterdam Neuroscience, Amsterdam, the Netherlands
| | - C L H Bockting
- Amsterdam UMC location University of Amsterdam, Department of Psychiatry, Meibergdreef 9, Amsterdam, Netherlands; Amsterdam Neuroscience, Amsterdam, the Netherlands
| | - D Denys
- Amsterdam UMC location University of Amsterdam, Department of Psychiatry, Meibergdreef 9, Amsterdam, Netherlands; Amsterdam Neuroscience, Amsterdam, the Netherlands
| | - G A van Wingen
- Amsterdam UMC location University of Amsterdam, Department of Psychiatry, Meibergdreef 9, Amsterdam, Netherlands; Amsterdam Neuroscience, Amsterdam, the Netherlands.
| |
Collapse
|
19
|
Ali FZ, Wengler K, He X, Nguyen MH, Parsey RV, DeLorenzo C. Gradient boosting decision-tree-based algorithm with neuroimaging for personalized treatment in depression. NEUROSCIENCE INFORMATICS 2022; 2:100110. [PMID: 36699194 PMCID: PMC9873411 DOI: 10.1016/j.neuri.2022.100110] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
Introduction Pretreatment positron emission tomography (PET) with 2-deoxy-2-[18F]fluoro-D-glucose (FDG) and magnetic resonance spectroscopy (MRS) may identify biomarkers for predicting remission (absence of depression). Yet, no such image-based biomarkers have achieved clinical validity. The purpose of this study was to identify biomarkers of remission using machine learning (ML) with pretreatment FDG-PET/MRS neuroimaging, to reduce patient suffering and economic burden from ineffective trials. Methods This study used simultaneous PET/MRS neuroimaging from a double-blind, placebo-controlled, randomized antidepressant trial on 60 participants with major depressive disorder (MDD) before initiating treatment. After eight weeks of treatment, those with ≤ 7 on 17-item Hamilton Depression Rating Scale were designated a priori as remitters (free of depression, 37%). Metabolic rate of glucose uptake (metabolism) from 22 brain regions were acquired from PET. Concentrations (mM) of glutamine and glutamate and gamma-aminobutyric acid (GABA) in anterior cingulate cortex were quantified from MRS. The data were randomly split into 67% train and cross-validation (n = 40), and 33% test (n = 20) sets. The imaging features, along with age, sex, handedness, and treatment assignment (selective serotonin reuptake inhibitor or SSRI vs. placebo) were entered into the eXtreme Gradient Boosting (XGBoost) classifier for training. Results In test data, the model showed 62% sensitivity, 92% specificity, and 77% weighted accuracy. Pretreatment metabolism of left hippocampus from PET was the most predictive of remission. Conclusions The pretreatment neuroimaging takes around 60 minutes but has potential to prevent weeks of failed treatment trials. This study effectively addresses common issues for neuroimaging analysis, such as small sample size, high dimensionality, and class imbalance.
Collapse
Affiliation(s)
- Farzana Z. Ali
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY, USA
| | - Kenneth Wengler
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY, USA
- Department of Psychiatry, Columbia University and New York State Psychiatric Institute, New York, NY, USA
| | - Xiang He
- Department of Radiology, Stony Brook Medicine, Stony Brook, NY, USA
- Department of Radiology, Northshore University Hospital, Manhasset, NY, USA
| | - Minh Hoai Nguyen
- Department of Computer Science, Stony Brook University, Stony Brook, NY, USA
| | - Ramin V. Parsey
- Department of Psychiatry, Renaissance School of Medicine at Stony Brook University, Stony Brook, NY, USA
| | - Christine DeLorenzo
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY, USA
- Department of Psychiatry, Columbia University and New York State Psychiatric Institute, New York, NY, USA
- Department of Psychiatry, Renaissance School of Medicine at Stony Brook University, Stony Brook, NY, USA
| |
Collapse
|
20
|
Yang B, Huang Y, Li Z, Hu X. Management of Post-stroke Depression (PSD) by Electroencephalography for Effective Rehabilitation. ENGINEERED REGENERATION 2022. [DOI: 10.1016/j.engreg.2022.11.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/03/2022] Open
|
21
|
Pinotsis DA, Fitzgerald S, See C, Sementsova A, Widge AS. Toward biophysical markers of depression vulnerability. Front Psychiatry 2022; 13:938694. [PMID: 36329919 PMCID: PMC9622949 DOI: 10.3389/fpsyt.2022.938694] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/07/2022] [Accepted: 09/22/2022] [Indexed: 11/13/2022] Open
Abstract
A major difficulty with treating psychiatric disorders is their heterogeneity: different neural causes can lead to the same phenotype. To address this, we propose describing the underlying pathophysiology in terms of interpretable, biophysical parameters of a neural model derived from the electroencephalogram. We analyzed data from a small patient cohort of patients with depression and controls. Using DCM, we constructed biophysical models that describe neural dynamics in a cortical network activated during a task that is used to assess depression state. We show that biophysical model parameters are biomarkers, that is, variables that allow subtyping of depression at a biological level. They yield a low dimensional, interpretable feature space that allowed description of differences between individual patients with depressive symptoms. They could capture internal heterogeneity/variance of depression state and achieve significantly better classification than commonly used EEG features. Our work is a proof of concept that a combination of biophysical models and machine learning may outperform earlier approaches based on classical statistics and raw brain data.
Collapse
Affiliation(s)
- D. A. Pinotsis
- Centre for Mathematical Neuroscience and Psychology, Department of Psychology, City, University of London, London, United Kingdom
- The Picower Institute for Learning and Memory, Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - S. Fitzgerald
- Centre for Mathematical Neuroscience and Psychology, Department of Psychology, City, University of London, London, United Kingdom
| | - C. See
- Department of Computer Science, City, University of London, London, United Kingdom
| | - A. Sementsova
- Department of Computer Science, City, University of London, London, United Kingdom
| | - A. S. Widge
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, United States
| |
Collapse
|
22
|
Karvelis P, Charlton CE, Allohverdi SG, Bedford P, Hauke DJ, Diaconescu AO. Computational approaches to treatment response prediction in major depression using brain activity and behavioral data: A systematic review. Netw Neurosci 2022; 6:1066-1103. [PMID: 38800454 PMCID: PMC11117101 DOI: 10.1162/netn_a_00233] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Accepted: 01/14/2022] [Indexed: 05/29/2024] Open
Abstract
Major depressive disorder is a heterogeneous diagnostic category with multiple available treatments. With the goal of optimizing treatment selection, researchers are developing computational models that attempt to predict treatment response based on various pretreatment measures. In this paper, we review studies that use brain activity data to predict treatment response. Our aim is to highlight and clarify important methodological differences between various studies that relate to the incorporation of domain knowledge, specifically within two approaches delineated as data-driven and theory-driven. We argue that theory-driven generative modeling, which explicitly models information processing in the brain and thus can capture disease mechanisms, is a promising emerging approach that is only beginning to be utilized in treatment response prediction. The predictors extracted via such models could improve interpretability, which is critical for clinical decision-making. We also identify several methodological limitations across the reviewed studies and provide suggestions for addressing them. Namely, we consider problems with dichotomizing treatment outcomes, the importance of investigating more than one treatment in a given study for differential treatment response predictions, the need for a patient-centered approach for defining treatment outcomes, and finally, the use of internal and external validation methods for improving model generalizability.
Collapse
Affiliation(s)
- Povilas Karvelis
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada
| | - Colleen E. Charlton
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada
| | - Shona G. Allohverdi
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada
| | - Peter Bedford
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada
| | - Daniel J. Hauke
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada
- Department of Psychiatry (UPK), University of Basel, Basel, Switzerland
- Department of Mathematics and Computer Science, University of Basel, Basel, Switzerland
| | - Andreea O. Diaconescu
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, ON, Canada
- University of Toronto, Department of Psychiatry, Toronto, ON, Canada
- Institute of Medical Sciences, University of Toronto, Toronto, ON, Canada
- Department of Psychology, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
23
|
Machine learning advances the classification and prediction of responding from psychophysiological reactions. JOURNAL OF CONTEXTUAL BEHAVIORAL SCIENCE 2022. [DOI: 10.1016/j.jcbs.2022.07.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
24
|
Benchmarks for machine learning in depression discrimination using electroencephalography signals. APPL INTELL 2022. [DOI: 10.1007/s10489-022-04159-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
25
|
Watts D, Pulice RF, Reilly J, Brunoni AR, Kapczinski F, Passos IC. Predicting treatment response using EEG in major depressive disorder: A machine-learning meta-analysis. Transl Psychiatry 2022; 12:332. [PMID: 35961967 PMCID: PMC9374666 DOI: 10.1038/s41398-022-02064-z] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Revised: 06/27/2022] [Accepted: 07/06/2022] [Indexed: 11/09/2022] Open
Abstract
Selecting a course of treatment in psychiatry remains a trial-and-error process, and this long-standing clinical challenge has prompted an increased focus on predictive models of treatment response using machine learning techniques. Electroencephalography (EEG) represents a cost-effective and scalable potential measure to predict treatment response to major depressive disorder. We performed separate meta-analyses to determine the ability of models to distinguish between responders and non-responders using EEG across treatments, as well as a performed subgroup analysis of response to transcranial magnetic stimulation (rTMS), and antidepressants (Registration Number: CRD42021257477) in Major Depressive Disorder by searching PubMed, Scopus, and Web of Science for articles published between January 1960 and February 2022. We included 15 studies that predicted treatment responses among patients with major depressive disorder using machine-learning techniques. Within a random-effects model with a restricted maximum likelihood estimator comprising 758 patients, the pooled accuracy across studies was 83.93% (95% CI: 78.90-89.29), with an Area-Under-the-Curve (AUC) of 0.850 (95% CI: 0.747-0.890), and partial AUC of 0.779. The average sensitivity and specificity across models were 77.96% (95% CI: 60.05-88.70), and 84.60% (95% CI: 67.89-92.39), respectively. In a subgroup analysis, greater performance was observed in predicting response to rTMS (Pooled accuracy: 85.70% (95% CI: 77.45-94.83), Area-Under-the-Curve (AUC): 0.928, partial AUC: 0.844), relative to antidepressants (Pooled accuracy: 81.41% (95% CI: 77.45-94.83, AUC: 0.895, pAUC: 0.821). Furthermore, across all meta-analyses, the specificity (true negatives) of EEG models was greater than the sensitivity (true positives), suggesting that EEG models thus far better identify non-responders than responders to treatment in MDD. Studies varied widely in important features across models, although relevant features included absolute and relative power in frontal and temporal electrodes, measures of connectivity, and asymmetry across hemispheres. Predictive models of treatment response using EEG hold promise in major depressive disorder, although there is a need for prospective model validation in independent datasets, and a greater emphasis on replicating physiological markers. Crucially, standardization in cut-off values and clinical scales for defining clinical response and non-response will aid in the reproducibility of findings and the clinical utility of predictive models. Furthermore, several models thus far have used data from open-label trials with small sample sizes and evaluated performance in the absence of training and testing sets, which increases the risk of statistical overfitting. Large consortium studies are required to establish predictive signatures of treatment response using EEG, and better elucidate the replicability of specific markers. Additionally, it is speculated that greater performance was observed in rTMS models, since EEG is assessing neural networks more likely to be directly targeted by rTMS, comprising electrical activity primarily near the surface of the cortex. Prospectively, there is a need for models that examine the comparative effectiveness of multiple treatments across the same patients. However, this will require a thoughtful consideration towards cumulative treatment effects, and whether washout periods between treatments should be utilised. Regardless, longitudinal cross-over trials comparing multiple treatments across the same group of patients will be an important prerequisite step to both facilitate precision psychiatry and identify generalizable physiological predictors of response between and across treatment options.
Collapse
Affiliation(s)
- Devon Watts
- grid.25073.330000 0004 1936 8227Neuroscience Graduate Program, McMaster University, Hamilton, Canada
| | - Rafaela Fernandes Pulice
- grid.8532.c0000 0001 2200 7498School of Medicine, Universidade Federal Do Rio Grande Do Sul, Porto Alegre, RS Brasil ,grid.414449.80000 0001 0125 3761Laboratório de Molecular Psychiatry, Centro de Pesquisa Experimental (CPE) and Centro de Pesquisa Clínica (CPC), Hospital de Clínicas de Porto Alegre (HCPA), Porto Alegre, RS Brasil
| | - Jim Reilly
- grid.25073.330000 0004 1936 8227Department of Electrical & Computer Engineering, McMaster University, Hamilton, ON Canada
| | - Andre R. Brunoni
- grid.11899.380000 0004 1937 0722Service of Interdisciplinary Neuromodulation, Laboratory of Neurosciences (LIM-27), Institute of Psychiatry, University of São Paulo, São Paulo, Brasil ,grid.11899.380000 0004 1937 0722Departamento de Clínica Médica, Faculdade de Medicina da USP, São Paulo, Brasil
| | - Flávio Kapczinski
- grid.25073.330000 0004 1936 8227Neuroscience Graduate Program, McMaster University, Hamilton, Canada ,grid.414449.80000 0001 0125 3761Laboratório de Molecular Psychiatry, Centro de Pesquisa Experimental (CPE) and Centro de Pesquisa Clínica (CPC), Hospital de Clínicas de Porto Alegre (HCPA), Porto Alegre, RS Brasil ,Instituto Nacional de Ciência e Tecnologia Translacional em Medicina (INCT-TM), Porto Alegre, RS Brasil ,grid.25073.330000 0004 1936 8227Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, ON Canada
| | - Ives Cavalcante Passos
- School of Medicine, Universidade Federal Do Rio Grande Do Sul, Porto Alegre, RS, Brasil. .,Laboratório de Molecular Psychiatry, Centro de Pesquisa Experimental (CPE) and Centro de Pesquisa Clínica (CPC), Hospital de Clínicas de Porto Alegre (HCPA), Porto Alegre, RS, Brasil.
| |
Collapse
|
26
|
Li Y, Shen Y, Fan X, Huang X, Yu H, Zhao G, Ma W. A novel EEG-based major depressive disorder detection framework with two-stage feature selection. BMC Med Inform Decis Mak 2022; 22:209. [PMID: 35933348 PMCID: PMC9357341 DOI: 10.1186/s12911-022-01956-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Accepted: 07/29/2022] [Indexed: 11/16/2022] Open
Abstract
Background Major depressive disorder (MDD) is a common mental illness, characterized by persistent depression, sadness, despair, etc., troubling people’s daily life and work seriously. Methods In this work, we present a novel automatic MDD detection framework based on EEG signals. First of all, we derive highly MDD-correlated features, calculating the ratio of extracted features from EEG signals at frequency bands between \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\beta$$\end{document}β and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha$$\end{document}α. Then, a two-stage feature selection method named PAR is presented with the sequential combination of Pearson correlation coefficient (PCC) and recursive feature elimination (RFE), where the advantages lie in minimizing the feature searching space. Finally, we employ widely used machine learning methods of support vector machine (SVM), logistic regression (LR), and linear regression (LNR) for MDD detection with the merit of feature interpretability. Results Experiment results show that our proposed MDD detection framework achieves competitive results. The accuracy and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$F_{1}$$\end{document}F1 score are up to 0.9895 and 0.9846, respectively. Meanwhile, the regression determination coefficient \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$R^2$$\end{document}R2 for MDD severity assessment is up to 0.9479. Compared with existing MDD detection methods with the best accuracy of 0.9840 and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$F_1$$\end{document}F1 score of 0.97, our proposed framework achieves the state-of-the-art MDD detection performance. Conclusions Development of this MDD detection framework can be potentially deployed into a medical system to aid physicians to screen out MDD patients.
Collapse
Affiliation(s)
- Yujie Li
- School of Computer Science, South China Normal University, Guangzhou, China
| | - Yingshan Shen
- School of Computer Science, South China Normal University, Guangzhou, China
| | - Xiaomao Fan
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China.
| | - Xingxian Huang
- Department of Acupuncture and Moxibustion, Shenzhen Traditional Chinese Medicine Hospital, Shenzhen, China
| | - Haibo Yu
- Department of Acupuncture and Moxibustion, Shenzhen Traditional Chinese Medicine Hospital, Shenzhen, China
| | - Gansen Zhao
- School of Computer Science, South China Normal University, Guangzhou, China
| | - Wenjun Ma
- School of Computer Science, South China Normal University, Guangzhou, China
| |
Collapse
|
27
|
van Dijk H, van Wingen G, Denys D, Olbrich S, van Ruth R, Arns M. The two decades brainclinics research archive for insights in neurophysiology (TDBRAIN) database. Sci Data 2022; 9:333. [PMID: 35701407 PMCID: PMC9198070 DOI: 10.1038/s41597-022-01409-z] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Accepted: 05/23/2022] [Indexed: 11/13/2022] Open
Abstract
In neuroscience, electroencephalography (EEG) data is often used to extract features (biomarkers) to identify neurological or psychiatric dysfunction or to predict treatment response. At the same time neuroscience is becoming more data-driven, made possible by computational advances. In support of biomarker development and methodologies such as training Artificial Intelligent (AI) networks we present the extensive Two Decades-Brainclinics Research Archive for Insights in Neurophysiology (TDBRAIN) EEG database. This clinical lifespan database (5-89 years) contains resting-state, raw EEG-data complemented with relevant clinical and demographic data of a heterogenous collection of 1274 psychiatric patients collected between 2001 to 2021. Main indications included are Major Depressive Disorder (MDD; N = 426), attention deficit hyperactivity disorder (ADHD; N = 271), Subjective Memory Complaints (SMC: N = 119) and obsessive-compulsive disorder (OCD; N = 75). Demographic-, personality- and day of measurement data are included in the database. Thirty percent of clinical and treatment outcome data will remain blinded for prospective validation and replication purposes. The TDBRAIN database and code are available on the Brainclinics Foundation website at www.brainclinics.com/resources and on Synapse at www.synapse.org/TDBRAIN .
Collapse
Affiliation(s)
- Hanneke van Dijk
- Research Institute Brainclinics, Brainclinics Foundation, Nijmegen, the Netherlands.
- Faculty of Psychology & Neuroscience, Department of Cognitive Neuroscience, Maastricht University, Maastricht, the Netherlands.
| | - Guido van Wingen
- Amsterdam UMC, Department of psychiatry, University of Amsterdam, location AMC, Amsterdam, the Netherlands
| | - Damiaan Denys
- Amsterdam UMC, Department of psychiatry, University of Amsterdam, location AMC, Amsterdam, the Netherlands
| | - Sebastian Olbrich
- Department for Psychiatry, Psychotherapy and Psychosomatics, University Hospital of Psychiatry Zurich, Zurich, Switzerland
| | | | - Martijn Arns
- Research Institute Brainclinics, Brainclinics Foundation, Nijmegen, the Netherlands
- Faculty of Psychology & Neuroscience, Department of Cognitive Neuroscience, Maastricht University, Maastricht, the Netherlands
| |
Collapse
|
28
|
A benchmark for prediction of psychiatric multimorbidity from resting EEG data in a large pediatric sample. Neuroimage 2022; 258:119348. [PMID: 35659998 DOI: 10.1016/j.neuroimage.2022.119348] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 05/26/2022] [Accepted: 05/31/2022] [Indexed: 11/23/2022] Open
Abstract
Psychiatric disorders are among the most common and debilitating illnesses across the lifespan and begin usually during childhood and adolescence, which emphasizes the importance of studying the developing brain. Most of the previous pediatric neuroimaging studies employed traditional univariate statistics on relatively small samples. Multivariate machine learning approaches have a great potential to overcome the limitations of these approaches. On the other hand, the vast majority of existing multivariate machine learning studies have focused on differentiating between children with an isolated psychiatric disorder and typically developing children. However, this line of research does not reflect the real-life situation as the majority of children with a clinical diagnosis have multiple psychiatric disorders (multimorbidity), and consequently, a clinician has the task to choose between different diagnoses and/or the combination of multiple diagnoses. Thus, the goal of the present benchmark is to predict psychiatric multimorbidity in children and adolescents. For this purpose, we implemented two kinds of machine learning benchmark challenges: The first challenge targets the prediction of the seven most prevalent DSM-V psychiatric diagnoses for the available data set, of which each individual can exhibit multiple ones concurrently (i.e. multi-task multi-label classification). Based on behavioral and cognitive measures, a second challenge focuses on predicting psychiatric symptom severity on a dimensional level (i.e. multiple regression task). For the present benchmark challenges, we will leverage existing and future data from the biobank of the Healthy Brain Network (HBN) initiative, which offers a unique large-sample dataset (N = 2042) that provides a wide array of different psychiatric developmental disorders and true hidden data sets. Due to limited real-world practicability and economic viability of MRI measurements, the present challenge will permit only resting state EEG data and demographic information to derive predictive models. We believe that a community driven effort to derive predictive markers from these data using advanced machine learning algorithms can help to improve the diagnosis of psychiatric developmental disorders.
Collapse
|
29
|
McNamara ME, Zisser M, Beevers CG, Shumake J. Not just “big” data: Importance of sample size, measurement error, and uninformative predictors for developing prognostic models for digital interventions. Behav Res Ther 2022; 153:104086. [DOI: 10.1016/j.brat.2022.104086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2021] [Revised: 03/11/2022] [Accepted: 04/05/2022] [Indexed: 11/24/2022]
|
30
|
Čukić M, López V. Progress in Objective Detection of Depression and Online Monitoring of Patients Based on Physiological Complexity. Front Psychiatry 2022; 13:828773. [PMID: 35418885 PMCID: PMC8995561 DOI: 10.3389/fpsyt.2022.828773] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Accepted: 03/02/2022] [Indexed: 11/13/2022] Open
Affiliation(s)
- Milena Čukić
- Institute for Technology of Knowledge, Complutense University, Madrid, Spain
- 3EGA B.V., Amsterdam, Netherlands
- General Physiology and Biophysics Department, Belgrade University, Belgrade, Serbia
| | - Victoria López
- Quantitative Methods Department, Cunef University, Madrid, Spain
| |
Collapse
|
31
|
Goodsmith N, Cruz M. Mental Health Services Research and Community Psychiatry. TEXTBOOK OF COMMUNITY PSYCHIATRY 2022:411-425. [DOI: 10.1007/978-3-031-10239-4_30] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
32
|
Fang X, Klawohn J, De Sabatino A, Kundnani H, Ryan J, Yu W, Hajcak G. Accurate classification of depression through optimized machine learning models on high-dimensional noisy data. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
33
|
Vozzi A, Ronca V, Aricò P, Borghini G, Sciaraffa N, Cherubino P, Trettel A, Babiloni F, Di Flumeri G. The Sample Size Matters: To What Extent the Participant Reduction Affects the Outcomes of a Neuroscientific Research. A Case-Study in Neuromarketing Field. SENSORS (BASEL, SWITZERLAND) 2021; 21:6088. [PMID: 34577294 PMCID: PMC8473095 DOI: 10.3390/s21186088] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Revised: 08/30/2021] [Accepted: 09/07/2021] [Indexed: 12/19/2022]
Abstract
The sample size is a crucial concern in scientific research and even more in behavioural neurosciences, where besides the best practice it is not always possible to reach large experimental samples. In this study we investigated how the outcomes of research change in response to sample size reduction. Three indices computed during a task involving the observations of four videos were considered in the analysis, two related to the brain electroencephalographic (EEG) activity and one to autonomic physiological measures, i.e., heart rate and skin conductance. The modifications of these indices were investigated considering five subgroups of sample size (32, 28, 24, 20, 16), each subgroup consisting of 630 different combinations made by bootstrapping n (n = sample size) out of 36 subjects, with respect to the total population (i.e., 36 subjects). The correlation analysis, the mean squared error (MSE), and the standard deviation (STD) of the indexes were studied at the participant reduction and three factors of influence were considered in the analysis: the type of index, the task, and its duration (time length). The findings showed a significant decrease of the correlation associated to the participant reduction as well as a significant increase of MSE and STD (p < 0.05). A threshold of subjects for which the outcomes remained significant and comparable was pointed out. The effects were to some extents sensitive to all the investigated variables, but the main effect was due to the task length. Therefore, the minimum threshold of subjects for which the outcomes were comparable increased at the reduction of the spot duration.
Collapse
Affiliation(s)
- Alessia Vozzi
- Department of Anatomical, Histological, Forensic & Orthopedic Sciences, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy;
- BrainSigns srl, Via Lungotevere Michelangelo, 9, 00192 Rome, Italy; (P.A.); (G.B.); (N.S.); (P.C.); (A.T.); (F.B.); (G.D.F.)
| | - Vincenzo Ronca
- Department of Anatomical, Histological, Forensic & Orthopedic Sciences, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy;
- BrainSigns srl, Via Lungotevere Michelangelo, 9, 00192 Rome, Italy; (P.A.); (G.B.); (N.S.); (P.C.); (A.T.); (F.B.); (G.D.F.)
| | - Pietro Aricò
- BrainSigns srl, Via Lungotevere Michelangelo, 9, 00192 Rome, Italy; (P.A.); (G.B.); (N.S.); (P.C.); (A.T.); (F.B.); (G.D.F.)
- Department of Molecular Medicine, Sapienza University of Rome, Viale Regina Elena, 291, 00161 Rome, Italy
| | - Gianluca Borghini
- BrainSigns srl, Via Lungotevere Michelangelo, 9, 00192 Rome, Italy; (P.A.); (G.B.); (N.S.); (P.C.); (A.T.); (F.B.); (G.D.F.)
- Department of Molecular Medicine, Sapienza University of Rome, Viale Regina Elena, 291, 00161 Rome, Italy
| | - Nicolina Sciaraffa
- BrainSigns srl, Via Lungotevere Michelangelo, 9, 00192 Rome, Italy; (P.A.); (G.B.); (N.S.); (P.C.); (A.T.); (F.B.); (G.D.F.)
- Department of Molecular Medicine, Sapienza University of Rome, Viale Regina Elena, 291, 00161 Rome, Italy
| | - Patrizia Cherubino
- BrainSigns srl, Via Lungotevere Michelangelo, 9, 00192 Rome, Italy; (P.A.); (G.B.); (N.S.); (P.C.); (A.T.); (F.B.); (G.D.F.)
- Department of Molecular Medicine, Sapienza University of Rome, Viale Regina Elena, 291, 00161 Rome, Italy
| | - Arianna Trettel
- BrainSigns srl, Via Lungotevere Michelangelo, 9, 00192 Rome, Italy; (P.A.); (G.B.); (N.S.); (P.C.); (A.T.); (F.B.); (G.D.F.)
| | - Fabio Babiloni
- BrainSigns srl, Via Lungotevere Michelangelo, 9, 00192 Rome, Italy; (P.A.); (G.B.); (N.S.); (P.C.); (A.T.); (F.B.); (G.D.F.)
- Department of Molecular Medicine, Sapienza University of Rome, Viale Regina Elena, 291, 00161 Rome, Italy
- Department of Computer Science, Hangzhou Dianzi University, Hangzhou 310018, China
| | - Gianluca Di Flumeri
- BrainSigns srl, Via Lungotevere Michelangelo, 9, 00192 Rome, Italy; (P.A.); (G.B.); (N.S.); (P.C.); (A.T.); (F.B.); (G.D.F.)
- Department of Molecular Medicine, Sapienza University of Rome, Viale Regina Elena, 291, 00161 Rome, Italy
| |
Collapse
|
34
|
Lee EE, Torous J, De Choudhury M, Depp CA, Graham SA, Kim HC, Paulus MP, Krystal JH, Jeste DV. Artificial Intelligence for Mental Health Care: Clinical Applications, Barriers, Facilitators, and Artificial Wisdom. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2021; 6:856-864. [PMID: 33571718 PMCID: PMC8349367 DOI: 10.1016/j.bpsc.2021.02.001] [Citation(s) in RCA: 47] [Impact Index Per Article: 15.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2020] [Revised: 02/01/2021] [Accepted: 02/02/2021] [Indexed: 12/19/2022]
Abstract
Artificial intelligence (AI) is increasingly employed in health care fields such as oncology, radiology, and dermatology. However, the use of AI in mental health care and neurobiological research has been modest. Given the high morbidity and mortality in people with psychiatric disorders, coupled with a worsening shortage of mental health care providers, there is an urgent need for AI to help identify high-risk individuals and provide interventions to prevent and treat mental illnesses. While published research on AI in neuropsychiatry is rather limited, there is a growing number of successful examples of AI's use with electronic health records, brain imaging, sensor-based monitoring systems, and social media platforms to predict, classify, or subgroup mental illnesses as well as problems such as suicidality. This article is the product of a study group held at the American College of Neuropsychopharmacology conference in 2019. It provides an overview of AI approaches in mental health care, seeking to help with clinical diagnosis, prognosis, and treatment, as well as clinical and technological challenges, focusing on multiple illustrative publications. Although AI could help redefine mental illnesses more objectively, identify them at a prodromal stage, personalize treatments, and empower patients in their own care, it must address issues of bias, privacy, transparency, and other ethical concerns. These aspirations reflect human wisdom, which is more strongly associated than intelligence with individual and societal well-being. Thus, the future AI or artificial wisdom could provide technology that enables more compassionate and ethically sound care to diverse groups of people.
Collapse
Affiliation(s)
- Ellen E Lee
- Department of Psychiatry, University of California San Diego, San Diego, California; Sam and Rose Stein Institute for Research on Aging, University of California San Diego, San Diego, California; VA San Diego Healthcare System, San Diego, California
| | - John Torous
- Department of Psychiatry, Beth Israel Deaconess Medical Center and Harvard University, Boston, Massachusetts
| | - Munmun De Choudhury
- School of Interactive Computing, Georgia Institute of Technology, Atlanta, Georgia
| | - Colin A Depp
- Department of Psychiatry, University of California San Diego, San Diego, California; Sam and Rose Stein Institute for Research on Aging, University of California San Diego, San Diego, California; VA San Diego Healthcare System, San Diego, California
| | - Sarah A Graham
- Department of Psychiatry, University of California San Diego, San Diego, California; Sam and Rose Stein Institute for Research on Aging, University of California San Diego, San Diego, California
| | - Ho-Cheol Kim
- AI and Cognitive Software, IBM Research-Almaden, San Jose, California
| | | | - John H Krystal
- Department of Psychiatry, Yale University, New Haven, Connecticut
| | - Dilip V Jeste
- Department of Psychiatry, University of California San Diego, San Diego, California; Department of Neurosciences, University of California San Diego, San Diego, California; Sam and Rose Stein Institute for Research on Aging, University of California San Diego, San Diego, California.
| |
Collapse
|
35
|
Prediction of drug response in major depressive disorder using ensemble of transfer learning with convolutional neural network based on EEG. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.06.006] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
|
36
|
Masychev K, Ciprian C, Ravan M, Reilly JP, MacCrimmon D. Advanced Signal Processing Methods for Characterization of Schizophrenia. IEEE Trans Biomed Eng 2021; 68:1123-1130. [PMID: 33656984 DOI: 10.1109/tbme.2020.3011842] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Schizophrenia is a severe mental disorder associated with nerobiological deficits. Auditory oddball P300 have been found to be one of the most consistent markers of schizophrenia. The goal of this study is to find quantitative features that can objectively distinguish patients with schizophrenia (SCZs) from healthy controls (HCs) based on their recorded auditory odd-ball P300 electroencephalogram (EEG) data. METHODS Using EEG dataset, we develop a machine learning (ML) algorithm to distinguish 57 SCZs from 66 HCs. The proposed ML algorithm has three steps. In the first step, a brain source localization (BSL) procedure using the linearly constrained minimum variance (LCMV) beamforming approach is employed on EEG signals to extract source waveforms from 30 specified brain regions. In the second step, a method for estimating effective connectivity, referred to as symbolic transfer entropy (STE), is applied to the source waveforms. In the third step the ML algorithm is applied to the STE connectivity matrix to determine whether a set of features can be found that successfully discriminate SCZ from HC. RESULTS The findings revealed that the SCZs have significantly higher effective connectivity compared to HCs and the selected STE features could achieve an accuracy of 92.68%, with a sensitivity of 92.98% and specificity of 92.42%. CONCLUSION The findings imply that the extracted features are from the regions that are mainly affected by SCZ and can be used to distinguish SCZs from HCs. SIGNIFICANCE The proposed ML algorithm may prove to be a promising tool for the clinical diagnosis of schizophrenia.
Collapse
|
37
|
Shumake J, Mallard TT, McGeary JE, Beevers CG. Inclusion of genetic variants in an ensemble of gradient boosting decision trees does not improve the prediction of citalopram treatment response. Sci Rep 2021; 11:3780. [PMID: 33580158 PMCID: PMC7881144 DOI: 10.1038/s41598-021-83338-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2020] [Accepted: 02/02/2021] [Indexed: 12/28/2022] Open
Abstract
Identifying in advance who is unlikely to respond to a specific antidepressant treatment is crucial to precision medicine efforts. The current work leverages genome-wide genetic variation and machine learning to predict response to the antidepressant citalopram using data from the Sequenced Treatment Alternatives to Relieve Depression (STAR*D) trial (n = 1257 with both valid genomic and outcome data). A confirmatory approach selected 11 SNPs previously reported to predict response to escitalopram in a sample different from the current study. A novel exploratory approach selected SNPs from across the genome using nested cross-validation with elastic net logistic regression with a predominantly lasso penalty (alpha = 0.99). SNPs from each approach were combined with baseline clinical predictors and treatment response outcomes were predicted using a stacked ensemble of gradient boosting decision trees. Using pre-treatment clinical and symptom predictors only, out-of-fold prediction of a novel treatment response definition based on STAR*D treatment guidelines was acceptable, AUC = .659, 95% CI [0.629, 0.689]. The inclusion of SNPs using confirmatory or exploratory selection methods did not improve the out-of-fold prediction of treatment response (AUCs were .662, 95% CI [0.632, 0.692] and .655, 95% CI [0.625, 0.685], respectively). A similar pattern of results were observed for the secondary outcomes of the presence or absence of distressing side effects regardless of treatment response and achieving remission or satisfactory partial response, assuming medication tolerance. In the current study, incorporating SNP variation into prognostic models did not enhance the prediction of citalopram response in the STAR*D sample.
Collapse
Affiliation(s)
- Jason Shumake
- Department of Psychology, Institute for Mental Health Research, University of Texas At Austin, 305 E. 23rd St., E9000, Austin, TX, 78712, USA.
| | - Travis T Mallard
- Department of Psychology, Institute for Mental Health Research, University of Texas At Austin, 305 E. 23rd St., E9000, Austin, TX, 78712, USA
| | - John E McGeary
- Providence Veterans Affairs Hospital and Brown University School of Medicine, Providence, RI, USA
| | - Christopher G Beevers
- Department of Psychology, Institute for Mental Health Research, University of Texas At Austin, 305 E. 23rd St., E9000, Austin, TX, 78712, USA.
| |
Collapse
|
38
|
Uyulan C, Ergüzel TT, Unubol H, Cebi M, Sayar GH, Nezhad Asad M, Tarhan N. Major Depressive Disorder Classification Based on Different Convolutional Neural Network Models: Deep Learning Approach. Clin EEG Neurosci 2021; 52:38-51. [PMID: 32491928 DOI: 10.1177/1550059420916634] [Citation(s) in RCA: 46] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
The human brain is characterized by complex structural, functional connections that integrate unique cognitive characteristics. There is a fundamental hurdle for the evaluation of both structural and functional connections of the brain and the effects in the diagnosis and treatment of neurodegenerative diseases. Currently, there is no clinically specific diagnostic biomarker capable of confirming the diagnosis of major depressive disorder (MDD). Therefore, exploring translational biomarkers of mood disorders based on deep learning (DL) has valuable potential with its recently underlined promising outcomes. In this article, an electroencephalography (EEG)-based diagnosis model for MDD is built through advanced computational neuroscience methodology coupled with a deep convolutional neural network (CNN) approach. EEG recordings are analyzed by modeling 3 different deep CNN structure, namely, ResNet-50, MobileNet, Inception-v3, in order to dichotomize MDD patients and healthy controls. EEG data are collected for 4 main frequency bands (Δ, θ, α, and β, accompanying spatial resolution with location information by collecting data from 19 electrodes. Following the pre-processing step, different DL architectures were employed to underline discrimination performance by comparing classification accuracies. The classification performance of models based on location data, MobileNet architecture generated 89.33% and 92.66% classification accuracy. As to the frequency bands, delta frequency band outperformed compared to other bands with 90.22% predictive accuracy and area under curve (AUC) value of 0.9 for ResNet-50 architecture. The main contribution of the study is the delineation of distinctive spatial and temporal features using various DL architectures to dichotomize 46 MDD subjects from 46 healthy subjects. Exploring translational biomarkers of mood disorders based on DL perspective is the main focus of this study and, though it is challenging, with its promising potential to improve our understanding of the psychiatric disorders, computational methods are highly worthy for the diagnosis process and valuable in terms of both speed and accuracy compared with classical approaches.
Collapse
Affiliation(s)
- Caglar Uyulan
- Department of Mechatronics, Faculty of Engineering, Bulent Ecevit University, Zonguldak, Turkey
| | - Türker Tekin Ergüzel
- Department of Software Engineering, Faculty of Engineering and Natural Sciences, Uskudar University, Istanbul, Turkey
| | - Huseyin Unubol
- Department of Psychology, Faculty of Humanities and Social Sciences, Uskudar University, Istanbul, Turkey.,NP Istanbul Brain Hospital, Istanbul, Turkey
| | - Merve Cebi
- Department of Psychology, Faculty of Humanities and Social Sciences, Uskudar University, Istanbul, Turkey.,NP Istanbul Brain Hospital, Istanbul, Turkey
| | - Gokben Hizli Sayar
- Department of Psychology, Faculty of Humanities and Social Sciences, Uskudar University, Istanbul, Turkey.,NP Istanbul Brain Hospital, Istanbul, Turkey
| | | | - Nevzat Tarhan
- Department of Psychology, Faculty of Humanities and Social Sciences, Uskudar University, Istanbul, Turkey.,NP Istanbul Brain Hospital, Istanbul, Turkey
| |
Collapse
|
39
|
Čukić M, López V, Pavón J. Classification of Depression Through Resting-State Electroencephalogram as a Novel Practice in Psychiatry: Review. J Med Internet Res 2020; 22:e19548. [PMID: 33141088 PMCID: PMC7671839 DOI: 10.2196/19548] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2020] [Revised: 07/19/2020] [Accepted: 09/04/2020] [Indexed: 12/28/2022] Open
Abstract
Background Machine learning applications in health care have increased considerably in the recent past, and this review focuses on an important application in psychiatry related to the detection of depression. Since the advent of computational psychiatry, research based on functional magnetic resonance imaging has yielded remarkable results, but these tools tend to be too expensive for everyday clinical use. Objective This review focuses on an affordable data-driven approach based on electroencephalographic recordings. Web-based applications via public or private cloud-based platforms would be a logical next step. We aim to compare several different approaches to the detection of depression from electroencephalographic recordings using various features and machine learning models. Methods To detect depression, we reviewed published detection studies based on resting-state electroencephalogram with final machine learning, and to predict therapy outcomes, we reviewed a set of interventional studies using some form of stimulation in their methodology. Results We reviewed 14 detection studies and 12 interventional studies published between 2008 and 2019. As direct comparison was not possible due to the large diversity of theoretical approaches and methods used, we compared them based on the steps in analysis and accuracies yielded. In addition, we compared possible drawbacks in terms of sample size, feature extraction, feature selection, classification, internal and external validation, and possible unwarranted optimism and reproducibility. In addition, we suggested desirable practices to avoid misinterpretation of results and optimism. Conclusions This review shows the need for larger data sets and more systematic procedures to improve the use of the solution for clinical diagnostics. Therefore, regulation of the pipeline and standard requirements for methodology used should become mandatory to increase the reliability and accuracy of the complete methodology for it to be translated to modern psychiatry.
Collapse
Affiliation(s)
- Milena Čukić
- HealthInc 3EGA, Amsterdam Health and Technology Institute, Amsterdam, Netherlands
| | - Victoria López
- Instituto de Tecnología del Conocimiento, Institute of Knowledge Technology, Universidad Complutense Madrid, Ciudad Universitaria s/n, 28040, Madrid, Spain
| | - Juan Pavón
- Instituto de Tecnología del Conocimiento, Institute of Knowledge Technology, Universidad Complutense Madrid, Ciudad Universitaria s/n, 28040, Madrid, Spain
| |
Collapse
|
40
|
Silva KD, Lee WK, Forbes A, Demmer RT, Barton C, Enticott J. Use and performance of machine learning models for type 2 diabetes prediction in community settings: A systematic review and meta-analysis. Int J Med Inform 2020; 143:104268. [PMID: 32950874 DOI: 10.1016/j.ijmedinf.2020.104268] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Revised: 08/30/2020] [Accepted: 09/02/2020] [Indexed: 12/11/2022]
Abstract
OBJECTIVE We aimed to identify machine learning (ML) models for type 2 diabetes (T2DM) prediction in community settings and determine their predictive performance. METHOD Systematic review of ML predictive modelling studies in 13 databases since 2009 was conducted. Primary outcomes included metrics of discrimination, calibration, and classification. Secondary outcomes included important variables, level of validation, and intended use of models. Meta-analysis of c-indices, subgroup analyses, meta-regression, publication bias assessments and sensitivity analyses were conducted. RESULTS Twenty-three studies (40 prediction models) were included. Studies with high-, moderate-, and low- risk of bias were 3, 14, and 6 respectively. All studies conducted internal validation whereas none conducted external validation of their models. Twenty studies provided classification metrics to varying extents whereas only 7 studies performed model calibration. Eighteen studies reported information on both the variables used for model development and the feature importance. Twelve studies highlighted potential applicability of their models for T2DM screening. Meta-analysis produced a good pooled c-index (0.812). Sources of heterogeneity were identified through subgroup analyses and meta-regression. Issues pertaining to methodological quality and reporting were observed. CONCLUSIONS We found evidence of good performance of ML models for T2DM prediction in the community. Improvements to methodology, reporting and validation are needed before they can be used at scale.
Collapse
Affiliation(s)
- Kushan De Silva
- Monash Centre for Health Research and Implementation, School of Public Health and Preventive Medicine, Faculty of Medicine, Nursing, and Health Sciences, Monash University, Clayton, Victoria, Australia.
| | - Wai Kit Lee
- Monash Centre for Health Research and Implementation, School of Public Health and Preventive Medicine, Faculty of Medicine, Nursing, and Health Sciences, Monash University, Clayton, Victoria, Australia
| | - Andrew Forbes
- Biostatistics Unit, Division of Research Methodology, School of Public Health and Preventive Medicine, Faculty of Medicine, Nursing, and Health Sciences, Monash University, Melbourne, Victoria, Australia
| | - Ryan T Demmer
- Division of Epidemiology and Community Health, School of Public Health, University of Minnesota, Minneapolis, Minnesota, USA; Mailman School of Public Health, Columbia University, New York, USA
| | - Christopher Barton
- Department of General Practice, School of Primary and Allied Health Care, Faculty of Medicine, Nursing, and Health Sciences, Monash University, Notting Hill, Victoria, Australia
| | - Joanne Enticott
- Monash Centre for Health Research and Implementation, School of Public Health and Preventive Medicine, Faculty of Medicine, Nursing, and Health Sciences, Monash University, Clayton, Victoria, Australia
| |
Collapse
|
41
|
Rajpurkar P, Yang J, Dass N, Vale V, Keller AS, Irvin J, Taylor Z, Basu S, Ng A, Williams LM. Evaluation of a Machine Learning Model Based on Pretreatment Symptoms and Electroencephalographic Features to Predict Outcomes of Antidepressant Treatment in Adults With Depression: A Prespecified Secondary Analysis of a Randomized Clinical Trial. JAMA Netw Open 2020; 3:e206653. [PMID: 32568399 PMCID: PMC7309440 DOI: 10.1001/jamanetworkopen.2020.6653] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/24/2022] Open
Abstract
IMPORTANCE Despite the high prevalence and potential outcomes of major depressive disorder, whether and how patients will respond to antidepressant medications is not easily predicted. OBJECTIVE To identify the extent to which a machine learning approach, using gradient-boosted decision trees, can predict acute improvement for individual depressive symptoms with antidepressants based on pretreatment symptom scores and electroencephalographic (EEG) measures. DESIGN, SETTING, AND PARTICIPANTS This prognostic study analyzed data collected as part of the International Study to Predict Optimized Treatment in Depression, a randomized, prospective open-label trial to identify clinically useful predictors and moderators of response to commonly used first-line antidepressant medications. Data collection was conducted at 20 sites spanning 5 countries and including 518 adult outpatients (18-65 years of age) from primary care or specialty care practices who received a diagnosis of current major depressive disorder between December 1, 2008, and September 30, 2013. Patients were antidepressant medication naive or willing to undergo a 1-week washout period of any nonprotocol antidepressant medication. Statistical analysis was conducted from January 5 to June 30, 2019. EXPOSURES Participants with major depressive disorder were randomized in a 1:1:1 ratio to undergo 8 weeks of treatment with escitalopram oxalate (n = 162), sertraline hydrochloride (n = 176), or extended-release venlafaxine hydrochloride (n = 180). MAIN OUTCOMES AND MEASURES The primary objective was to predict improvement in individual symptoms, defined as the difference in score for each of the symptoms on the 21-item Hamilton Rating Scale for Depression from baseline to week 8, evaluated using the C index. RESULTS The resulting data set contained 518 patients (274 women; mean [SD] age, 39.0 [12.6] years; mean [SD] 21-item Hamilton Rating Scale for Depression score improvement, 13.0 [7.0]). With the use of 5-fold cross-validation for evaluation, the machine learning model achieved C index scores of 0.8 or higher on 12 of 21 clinician-rated symptoms, with the highest C index score of 0.963 (95% CI, 0.939-1.000) for loss of insight. The importance of any single EEG feature was higher than 5% for prediction of 7 symptoms, with the most important EEG features being the absolute delta band power at the occipital electrode sites (O1, 18.8%; Oz, 6.7%) for loss of insight. Over and above the use of baseline symptom scores alone, the use of both EEG and baseline symptom features was associated with a significant increase in the C index for improvement in 4 symptoms: loss of insight (C index increase, 0.012 [95% CI, 0.001-0.020]), energy loss (C index increase, 0.035 [95% CI, 0.011-0.059]), appetite changes (C index increase, 0.017 [95% CI, 0.003-0.030]), and psychomotor retardation (C index increase, 0.020 [95% CI, 0.008-0.032]). CONCLUSIONS AND RELEVANCE This study suggests that machine learning may be used to identify independent associations of symptoms and EEG features to predict antidepressant-associated improvements in specific symptoms of depression. The approach should next be prospectively validated in clinical trials and settings. TRIAL REGISTRATION ClinicalTrials.gov Identifier: NCT00693849.
Collapse
Affiliation(s)
- Pranav Rajpurkar
- Department of Computer Science, Stanford University, Stanford, California
| | - Jingbo Yang
- Department of Computer Science, Stanford University, Stanford, California
| | - Nathan Dass
- Department of Computer Science, Stanford University, Stanford, California
| | - Vinjai Vale
- Department of Computer Science, Stanford University, Stanford, California
| | - Arielle S. Keller
- Stanford Center for Precision Mental Health and Wellness, Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California
| | - Jeremy Irvin
- Department of Computer Science, Stanford University, Stanford, California
| | - Zachary Taylor
- Stanford Center for Precision Mental Health and Wellness, Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California
| | - Sanjay Basu
- Center for Primary Care, Harvard Medical School, Boston, Massachusetts
- Research and Analytics, Collective Health, San Francisco, California
- Division of Primary Care and Public Health, Imperial College London School of Public Health, London, United Kingdom
| | - Andrew Ng
- Department of Computer Science, Stanford University, Stanford, California
| | - Leanne M. Williams
- Stanford Center for Precision Mental Health and Wellness, Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California
| |
Collapse
|
42
|
Predicting treatment effects in unipolar depression: A meta-review. Pharmacol Ther 2020; 212:107557. [PMID: 32437828 DOI: 10.1016/j.pharmthera.2020.107557] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2019] [Accepted: 04/23/2020] [Indexed: 12/23/2022]
Abstract
There is increasing interest in clinical prediction models in psychiatry, which focus on developing multivariate algorithms to guide personalized diagnostic or management decisions. The main target of these models is the prediction of treatment response to different antidepressant therapies. This is because the ability to predict response based on patients' personal data may allow clinicians to make improved treatment decisions, and to provide more efficacious or more tolerable medications to the right patient. We searched the literature for systematic reviews about treatment prediction in the context of existing treatment modalities for adult unipolar depression, until July 2019. Treatment effect is defined broadly to include efficacy, safety, tolerability and acceptability outcomes. We first focused on the identification of individual predictor variables that might predict treatment response, and second, we considered multivariate clinical prediction models. Our meta-review included a total of 10 systematic reviews; seven (from 2014 to 2018) focusing on individual predictor variables and three focusing on clinical prediction models. These identified a number of sociodemographic, phenomenological, clinical, neuroimaging, remote monitoring, genetic and serum marker variables as possible predictor variables for treatment response, alongside statistical and machine-learning approaches to clinical prediction model development. Effect sizes for individual predictor variables were generally small and clinical prediction models had generally not been validated in external populations. There is a need for rigorous model validation in large external data-sets to prove the clinical utility of models. We also discuss potential future avenues in the field of personalized psychiatry, particularly the combination of multiple sources of data and the emerging field of artificial intelligence and digital mental health to identify new individual predictor variables.
Collapse
|
43
|
Zhdanov A, Atluri S, Wong W, Vaghei Y, Daskalakis ZJ, Blumberger DM, Frey BN, Giacobbe P, Lam RW, Milev R, Mueller DJ, Turecki G, Parikh SV, Rotzinger S, Soares CN, Brenner CA, Vila-Rodriguez F, McAndrews MP, Kleffner K, Alonso-Prieto E, Arnott SR, Foster JA, Strother SC, Uher R, Kennedy SH, Farzan F. Use of Machine Learning for Predicting Escitalopram Treatment Outcome From Electroencephalography Recordings in Adult Patients With Depression. JAMA Netw Open 2020; 3:e1918377. [PMID: 31899530 PMCID: PMC6991244 DOI: 10.1001/jamanetworkopen.2019.18377] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
IMPORTANCE Social and economic costs of depression are exacerbated by prolonged periods spent identifying treatments that would be effective for a particular patient. Thus, a tool that reliably predicts an individual patient's response to treatment could significantly reduce the burden of depression. OBJECTIVE To estimate how accurately an outcome of escitalopram treatment can be predicted from electroencephalographic (EEG) data on patients with depression. DESIGN, SETTING, AND PARTICIPANTS This prognostic study used a support vector machine classifier to predict treatment outcome using data from the first Canadian Biomarker Integration Network in Depression (CAN-BIND-1) study. The CAN-BIND-1 study comprised 180 patients (aged 18-60 years) diagnosed with major depressive disorder who had completed 8 weeks of treatment. Of this group, 122 patients had EEG data recorded before the treatment; 115 also had EEG data recorded after the first 2 weeks of treatment. INTERVENTIONS All participants completed 8 weeks of open-label escitalopram (10-20 mg) treatment. MAIN OUTCOMES AND MEASURES The ability of EEG data to predict treatment outcome, measured as accuracy, specificity, and sensitivity of the classifier at baseline and after the first 2 weeks of treatment. The treatment outcome was defined in terms of change in symptom severity, measured by the Montgomery-Åsberg Depression Rating Scale, before and after 8 weeks of treatment. A patient was designated as a responder if the Montgomery-Åsberg Depression Rating Scale score decreased by at least 50% during the 8 weeks and as a nonresponder if the score decrease was less than 50%. RESULTS Of the 122 participants who completed a baseline EEG recording (mean [SD] age, 36.3 [12.7] years; 76 [62.3%] female), the classifier was able to identify responders with an estimated accuracy of 79.2% (sensitivity, 67.3%; specificity, 91.0%) when using only the baseline EEG data. For a subset of 115 participants who had additional EEG data recorded after the first 2 weeks of treatment, use of these data increased the accuracy to 82.4% (sensitivity, 79.2%; specificity, 85.5%). CONCLUSIONS AND RELEVANCE These findings demonstrate the potential utility of EEG as a treatment planning tool for escitalopram therapy. Further development of the classification tools presented in this study holds the promise of expediting the search for optimal treatment for each patient.
Collapse
Affiliation(s)
- Andrey Zhdanov
- School of Mechatronic Systems Engineering, Simon Fraser University, Surrey, British Columbia, Canada
- Centre for Engineering-Led Brain Research, Simon Fraser University, Surrey, British Columbia, Canada
| | - Sravya Atluri
- Temerty Centre for Therapeutic Brain Intervention, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Institute of Biomaterial and Biomedical Engineering, Toronto, Ontario, Canada
| | - Willy Wong
- The Edward S. Rogers Sr Department of Electrical & Computer Engineering, University of Toronto, Toronto, Ontario, Canada
| | - Yasaman Vaghei
- School of Mechatronic Systems Engineering, Simon Fraser University, Surrey, British Columbia, Canada
- Centre for Engineering-Led Brain Research, Simon Fraser University, Surrey, British Columbia, Canada
| | - Zafiris J. Daskalakis
- Temerty Centre for Therapeutic Brain Intervention, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Institute of Medical Science, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Daniel M. Blumberger
- Temerty Centre for Therapeutic Brain Intervention, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Institute of Medical Science, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Benicio N. Frey
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
- Mood Disorders Program and Women’s Health Concerns Clinic, St Joseph’s Healthcare Hamilton, Hamilton, Ontario, Canada
| | - Peter Giacobbe
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, University Health Network, University of Toronto, Toronto, Ontario, Canada
| | - Raymond W. Lam
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada
| | - Roumen Milev
- Departments of Psychiatry and Psychology, Queen’s University, Providence Care Hospital, Kingston, Ontario, Canada
| | - Daniel J. Mueller
- Temerty Centre for Therapeutic Brain Intervention, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
| | - Gustavo Turecki
- Department of Psychiatry, McGill University, Montreal, Quebec, Canada
| | | | - Susan Rotzinger
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, University Health Network, University of Toronto, Toronto, Ontario, Canada
- Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, Ontario, Canada
| | - Claudio N. Soares
- Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, Ontario, Canada
- Department of Psychiatry, Queen’s University, Kingston, Ontario, Canada
| | | | - Fidel Vila-Rodriguez
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada
| | - Mary Pat McAndrews
- Krembil Research Institute, University Health Network, Toronto, Ontario, Canada
| | - Killian Kleffner
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada
| | - Esther Alonso-Prieto
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada
| | - Stephen R. Arnott
- Rotman Research Institute, Baycrest Centre, Toronto, Ontario, Canada
| | - Jane A. Foster
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
- St Michael’s Hospital, Toronto, Ontario, Canada
| | - Stephen C. Strother
- Rotman Research Institute, Baycrest Centre, Toronto, Ontario, Canada
- Department of Medical Biophysics, University of Toronto, Toronto, Ontario, Canada
| | - Rudolf Uher
- Department of Psychiatry, Dalhousie University, Halifax, Nova Scotia, Canada
- Institute of Psychiatry, Psychology & Neuroscience, Social, Genetic and Developmental Psychiatry Centre, King’s College London, London, United Kingdom
| | - Sidney H. Kennedy
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Institute of Medical Science, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, University Health Network, University of Toronto, Toronto, Ontario, Canada
- Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, Ontario, Canada
- Krembil Research Institute, University Health Network, Toronto, Ontario, Canada
- St Michael’s Hospital, Toronto, Ontario, Canada
| | - Faranak Farzan
- School of Mechatronic Systems Engineering, Simon Fraser University, Surrey, British Columbia, Canada
- Centre for Engineering-Led Brain Research, Simon Fraser University, Surrey, British Columbia, Canada
- Temerty Centre for Therapeutic Brain Intervention, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Institute of Medical Science, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
44
|
Byun S, Kim AY, Jang EH, Kim S, Choi KW, Yu HY, Jeon HJ. Entropy analysis of heart rate variability and its application to recognize major depressive disorder: A pilot study. Technol Health Care 2020; 27:407-424. [PMID: 31045557 PMCID: PMC6597986 DOI: 10.3233/thc-199037] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
BACKGROUND The current method to evaluate major depressive disorder (MDD) relies on subjective clinical interviews and self-questionnaires. OBJECTIVE Autonomic imbalance in MDD patients is characterized using entropy measures of heart rate variability (HRV). A machine learning approach for screening depression based on the entropy is demonstrated. METHODS The participants experience five experimental phases: baseline (BASE), stress task (MAT), stress task recovery (REC1), relaxation task (RLX), and relaxation task recovery (REC2). The four entropy indices, approximate entropy, sample entropy, fuzzy entropy, and Shannon entropy, are extracted for each phase, and a total of 20 features are used. A support vector machine classifier and recursive feature elimination are employed for classification. RESULTS The entropy features are lower in the MDD group; however, the disease does not have a significant effect. Experimental tasks significantly affect the features. The entropy did not recover during REC1. The differences in the entropy features between the two groups increased after MAT and showed the largest gap in REC2. We achieved 70% accuracy, 64% sensitivity, and 76% specificity with three optimal features during RLX and REC2. CONCLUSION Monitoring of HRV complexity changes when a subject experiences autonomic arousal and recovery can potentially facilitate objective depression recognition.
Collapse
Affiliation(s)
- Sangwon Byun
- Department of Electronics Engineering, Incheon National University, Incheon 22012, Korea
| | - Ah Young Kim
- Bio-Medical IT Convergence Research Division, Electronics and Telecommunications Research Institute, Daejeon 34129, Korea
| | - Eun Hye Jang
- Bio-Medical IT Convergence Research Division, Electronics and Telecommunications Research Institute, Daejeon 34129, Korea
| | - Seunghwan Kim
- Bio-Medical IT Convergence Research Division, Electronics and Telecommunications Research Institute, Daejeon 34129, Korea
| | - Kwan Woo Choi
- Department of Psychiatry, Depression Center, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Korea.,Department of Psychiatry, Korea University Anam Hospital, Korea University College of Medicine, Seoul 02841, Korea
| | - Han Young Yu
- Bio-Medical IT Convergence Research Division, Electronics and Telecommunications Research Institute, Daejeon 34129, Korea
| | - Hong Jin Jeon
- Department of Psychiatry, Depression Center, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Korea
| |
Collapse
|
45
|
Internet-Based Management for Depressive Disorder. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2019; 1180:267-276. [PMID: 31784968 DOI: 10.1007/978-981-32-9271-0_14] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
The advances in the Internet and related technologies may lead to changes in professional roles of psychiatrists and psychotherapists. The application of artificial intelligence (AI) and electronic measurement-based care (eMBC) in the treatment of depressive disorder has addressed more interest. AI could play a role in population health management and patient administration as well as assist physicians to make a decision in the real-world clinical practice. The eMBC strengthens MBC through web/mobile devices and telephone consulting services, to monitor disease progression, and customizes the MBC interface in electronic medical record systems (EMRs).
Collapse
|
46
|
Can Machine Learning help us in dealing with treatment resistant depression? A review. J Affect Disord 2019; 259:21-26. [PMID: 31437696 DOI: 10.1016/j.jad.2019.08.009] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/13/2019] [Revised: 08/06/2019] [Accepted: 08/09/2019] [Indexed: 11/22/2022]
Abstract
BACKGROUND About one third of patients treated with antidepressant do not show sufficient symptoms relief and up to 15% of patients remain symptomatic even after multiple trials are applied, configuring a state called treatment resistant depression (TRD). A clear definition of this state and the understanding of underlying mechanisms contributing to chronic disability caused by major depressive disorder is still unknown. Therefore, Machine Learning (ML) techniques emerged in the last years as interesting approaches to deal with such complex problems. METHODS We performed a bibliographic search on Pubmed, Google Scholar and Medline of clinical, imaging, genetic and EEG ML classification studies on treatment-responding depression and TRD as well as studies trying to predict response to a specific treatment in already established TRD. The inclusion criteria were met by eleven studies. Seven focused on the definition of predictors of TRD onset while four attempted to predict the response to specific treatments in TRD. RESULTS The results showed that it seems possible to classify between responders MDD and TRD with good accuracies based on clinical variables. Moreover, some studies reported the possibility of using EEG measures to predict response to different pharmacological and non-pharmacological treatments in established TRD. LIMITATIONS The definition of TRD, the selection of variables together with ML algorithms and pipelines varies across the studies, ultimately determining the unfeasibility to implement these models in clinical practice. CONCLUSIONS The findings suggest that ML could be a valid approach to increase our understanding of TRD and to better classify and stratify this disorder, which may ultimately help clinicians in the assessment of major depressive disorders.
Collapse
|
47
|
Campigotto A, Bernardo T, Stone E, Stacey D, Poljak Z. An animal health example of managing and analyzing a large volume of data on a PC: Modeling body weight and age of over 13 million cats for explanatory and predictive purposes. Prev Vet Med 2019; 174:104824. [PMID: 31733427 DOI: 10.1016/j.prevetmed.2019.104824] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2019] [Revised: 10/23/2019] [Accepted: 11/01/2019] [Indexed: 10/25/2022]
Abstract
Large amounts of animal health data are available to researchers, but are often stored in different formats and information silos. Analysis of this existing information can provide new insights into the health and welfare of animals and possibly reduce the need to collect additional data. The objective of this study was to develop a method of managing and analyzing large amounts of data on a personal computer that can be run within 24 h to limit the time and resources spent deploying models on larger servers. This paper describes an overall approach that makes use of existing methods for data acquisition and modeling, but adapts and combines them in a way that allows manipulation and analysis of large volumes of data on a PC. This included a total of five steps: removing errors; removing data points outside the scope of a specific hypothesis; creating descriptive statistics; developing explanatory and/or predictive models; and assessing the fit or accuracy of the models created. The approach was developed using electronic medical records for 19,416,753 feline patients from 3972 anonymized veterinary clinics in the United States and Canada, recorded between January 1981 and June 2016. Data regarding patient signalment (age, sex, breed, reproductive status) and body weight were extracted from the records and used to create linear regression models to describe body weight in cats of different ages, breeds, genders and reproductive status. Ordinary least squares linear regression and stochastic gradient descent linear regression were compared to determine their effectiveness and suitability for creating predictive models with large datasets, using 10 fold cross validation. This approach could be used to build workflows to create models to determine exploratory and predictive properties of health parameters for animals and people. The ability to work with large datasets on a PC or equivalent technology was demonstrated. Significant interactions were present among sex, reproductive status and age. A peak in weight occurred between 6 and 9 years depending on the sex, reproductive status and breed. The predictive ability of the two models was similar, with both producing a root mean square error of 1.45 and a mean absolute error of 1.09, and mean error that was approximately zero on the validation dataset.
Collapse
Affiliation(s)
- Adam Campigotto
- Department of Population Medicine, Ontario Veterinary College, University of Guelph, 50 Stone Rd E, Guelph, Ontario, N1G 2W1, Canada.
| | - Theresa Bernardo
- Department of Population Medicine, Ontario Veterinary College, University of Guelph, 50 Stone Rd E, Guelph, Ontario, N1G 2W1, Canada
| | - Elizabeth Stone
- Department of Clinical Studies, Ontario Veterinary College, University of Guelph, 50 Stone Rd E, Guelph, Ontario, N1G 2W1, Canada
| | - Deborah Stacey
- School of Computer Science, University of Guelph, 50 Stone Rd E, Guelph, Ontario, N1G 2W1, Canada
| | - Zvonimir Poljak
- Department of Population Medicine, Ontario Veterinary College, University of Guelph, 50 Stone Rd E, Guelph, Ontario, N1G 2W1, Canada
| |
Collapse
|
48
|
Pearson R, Pisner D, Meyer B, Shumake J, Beevers CG. A machine learning ensemble to predict treatment outcomes following an Internet intervention for depression. Psychol Med 2019; 49:2330-2341. [PMID: 30392475 PMCID: PMC6763538 DOI: 10.1017/s003329171800315x] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/22/2018] [Revised: 09/06/2018] [Accepted: 10/05/2018] [Indexed: 11/06/2022]
Abstract
BACKGROUND Some Internet interventions are regarded as effective treatments for adult depression, but less is known about who responds to this form of treatment. METHOD An elastic net and random forest were trained to predict depression symptoms and related disability after an 8-week course of an Internet intervention, Deprexis, involving adults (N = 283) from across the USA. Candidate predictors included psychopathology, demographics, treatment expectancies, treatment usage, and environmental context obtained from population databases. Model performance was evaluated using predictive R2$\lpar R_{{\rm pred}}^2\rpar\comma $ the expected variance explained in a new sample, estimated by 10 repetitions of 10-fold cross-validation. RESULTS An ensemble model was created by averaging the predictions of the elastic net and random forest. Model performance was compared with a benchmark linear autoregressive model that predicted each outcome using only its baseline. The ensemble predicted more variance in post-treatment depression (8.0% gain, 95% CI 0.8-15; total $R_{{\rm pred}}^2 \; $= 0.25), disability (5.0% gain, 95% CI -0.3 to 10; total $R_{{\rm pred}}^2 \; $= 0.25), and well-being (11.6% gain, 95% CI 4.9-19; total $R_{{\rm pred}}^2 \; $= 0.29) than the benchmark model. Important predictors included comorbid psychopathology, particularly total psychopathology and dysthymia, low symptom-related disability, treatment credibility, lower access to therapists, and time spent using certain Deprexis modules. CONCLUSION A number of variables predict symptom improvement following an Internet intervention, but each of these variables makes relatively small contributions. Machine learning ensembles may be a promising statistical approach for identifying the cumulative contribution of many weak predictors to psychosocial depression treatment response.
Collapse
Affiliation(s)
- Rahel Pearson
- Department of Psychology, Institute for Mental Health Research, University of Texas at Austin, Austin, TX, USA
| | - Derek Pisner
- Department of Psychology, Institute for Mental Health Research, University of Texas at Austin, Austin, TX, USA
| | - Björn Meyer
- Gaia AG, Hamburg, Germany
- University of London, London, England, UK
| | - Jason Shumake
- Department of Psychology, Institute for Mental Health Research, University of Texas at Austin, Austin, TX, USA
| | - Christopher G. Beevers
- Department of Psychology, Institute for Mental Health Research, University of Texas at Austin, Austin, TX, USA
| |
Collapse
|
49
|
Hasanzadeh F, Mohebbi M, Rostami R. Prediction of rTMS treatment response in major depressive disorder using machine learning techniques and nonlinear features of EEG signal. J Affect Disord 2019; 256:132-142. [PMID: 31176185 DOI: 10.1016/j.jad.2019.05.070] [Citation(s) in RCA: 46] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/04/2019] [Revised: 05/15/2019] [Accepted: 05/28/2019] [Indexed: 12/18/2022]
Abstract
BACKGROUND Prediction of therapeutic outcome of repetitive transcranial magnetic stimulation (rTMS) treatment is an important purpose that eliminates financial and psychological consequences of applying inefficient therapy. To achieve this goal we proposed a method based on machine learning to classify responders (R) and non- responders (NR) to rTMS treatment for major depression disorder (MDD) patients. METHODS 19 electrodes resting state EEG was recorded from 46 MDD patients before treatment. Then patients underwent 7 weeks of rTMS, and 23 of them responded to treatment. Features extracted from EEG include Lempel-Ziv complexity (LZC), Katz fractal dimension (KFD), correlation dimension (CD), the power spectral density, features based on bispectrum, frontal and prefrontal cordance and combination of them. The most relevant features were selected by the minimal-redundancy-maximal-relevance (mRMR) feature selection algorithm. For classifying two groups of R and NR, k-nearest neighbors (KNN) were applied. The performance of the proposed method was evaluated by leave-1-out cross-validation. For further study, the capability of features in differentiating R and NR was investigated by a statistical test. RESULTS Effective EEG features for prediction of rTMS treatment response were found. EEG beta power, the sum of bispectrum diagonal elements in delta and beta bands and CD were the most discriminative features. Power of beta classified R and NR with the high performance of 91.3% accuracy, 91.3% specificity, and 91.3% sensitivity. LIMITATIONS Lack of large sample size restricted our method for using in clinical applications. CONCLUSION This considerable high accuracy indicates that our proposed method with power and some of the nonlinear and bispectral features can lead to promising results in predicting treatment outcome of rTMS for MDD patients only by one session pretreatment EEG recording.
Collapse
Affiliation(s)
- Fatemeh Hasanzadeh
- Department of Biomedical Engineering, Faculty of Electrical Engineering, K.N. Toosi University of Technology, Tehran, Iran
| | - Maryam Mohebbi
- Department of Biomedical Engineering, Faculty of Electrical Engineering, K.N. Toosi University of Technology, Tehran, Iran.
| | - Reza Rostami
- Department of Psychology, University of Tehran, Tehran, Iran
| |
Collapse
|
50
|
Mithani K, Meng Y, Abrahao A, Mikhail M, Hamani C, Giacobbe P, Lipsman N. Electroencephalography in Psychiatric Surgery: Past Use and Future Directions. Stereotact Funct Neurosurg 2019; 97:141-152. [PMID: 31412334 DOI: 10.1159/000500994] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2018] [Accepted: 05/08/2019] [Indexed: 11/19/2022]
Abstract
The last two decades have seen a re-emergence of surgery for intractable psychiatric disease, in large part due to increased use of deep brain stimulation. The development of more precise, image-guided, less invasive interventions has improved the safety of these procedures, even though the relative merits of modulation at various targets remain under investigation. With an increase in the number and type of interventions for modulating mood/anxiety circuits, the need for biomarkers to guide surgeries and predict treatment response is as critical as ever. Electroencephalography (EEG) has a long history in clinical neurology, cognitive neuroscience, and functional neurosurgery, but has limited prior usage in psychiatric surgery. MEDLINE, Embase, and Psyc-INFO searches on the use of EEG in guiding psychiatric surgery yielded 611 articles, which were screened for relevance and quality. We synthesized three important themes. First, considerable evidence supports EEG as a biomarker for response to various surgical and non-surgical therapies, but large-scale investigations are lacking. Second, intraoperative EEG is likely more valuable than surface EEG for guiding target selection, but comes at the cost of greater invasiveness. Finally, EEG may be a promising tool for objective functional feedback in developing "closed-loop" psychosurgeries, but more systematic investigations are required.
Collapse
Affiliation(s)
- Karim Mithani
- Sunnybrook Research Institute, Toronto, Ontario, Canada.,Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Ying Meng
- Sunnybrook Research Institute, Toronto, Ontario, Canada
| | | | - Mirriam Mikhail
- Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | | | | | - Nir Lipsman
- Sunnybrook Research Institute, Toronto, Ontario, Canada,
| |
Collapse
|