1
|
Jiang H, Liu A, Ying Z. Identification of texture MRI brain abnormalities on Fibromyalgia syndrome using interpretable machine learning models. Sci Rep 2024; 14:23525. [PMID: 39384824 PMCID: PMC11464731 DOI: 10.1038/s41598-024-74418-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Accepted: 09/25/2024] [Indexed: 10/11/2024] Open
Abstract
To provide objective diagnostic markers for fibromyalgia symptoms (FMS) diagnosis, we have created interpretable extreme gradient boosting (XGBoost) models using radiomics to aid in the diagnosis of chronic pain (CP) and to develop nomogram models for diagnosing subgroups of FMS. A group of 54 patients with CP and 71 healthy controls was randomly separated into training and validation groups, using a 7:3 ratio. Radiomics features were extracted from grey-matter and white-matter in the filtered mwp0* image. The Mann-Whitney U test, Spearman's rank correlation test, and least absolute shrinkage and selection operator (LASSO) were utilized to select features. An XGBoost model was created based on these features, and Shapley Additive exPlanations (SHAP) was used for personalization and visual interpretation. A nomogram was developed for the diagnosis of FMS subgroups, utilizing radiomics scores and clinical predictors. The efficacy of the nomogram was evaluated using the area under the receiver operating characteristic curve, while decision curve analysis was employed to evaluate its clinical efficacy. The XGBoost model displays stability in the training validation group, indicating lower overfitting of CP model. The nomogram model combined with the rad-score has a greater ability to distinguish between typical and sub-clinical than the clinical factor model alone. We developed and validated a CP diagnosis model by XGBoost and realized model visualization through SHAP. The rad-score obtained by machine learning was used to build a nomogram model that combines clinical scales to distinguish patients with typical and sub-clinical fibromyalgia.
Collapse
Affiliation(s)
- Hongyang Jiang
- Medical College of Soochow University, Suzhou, China
- Center for Rehabilitation Medicine, Department of Radiology, Zhejiang Provincial People's Hospital (Affiliated People's Hospital), Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Aihui Liu
- Center for General Practice Medicine, Department of Rheumatology and Immunology, Zhejiang Provincial People's Hospital (Affiliated People's Hospital), Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Zhenhua Ying
- Medical College of Soochow University, Suzhou, China.
| |
Collapse
|
2
|
Di Camillo F, Grimaldi DA, Cattarinussi G, Di Giorgio A, Locatelli C, Khuntia A, Enrico P, Brambilla P, Koutsouleris N, Sambataro F. Magnetic resonance imaging-based machine learning classification of schizophrenia spectrum disorders: a meta-analysis. Psychiatry Clin Neurosci 2024. [PMID: 39290174 DOI: 10.1111/pcn.13736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Revised: 07/31/2024] [Accepted: 08/19/2024] [Indexed: 09/19/2024]
Abstract
BACKGROUND Recent advances in multivariate pattern recognition have fostered the search for reliable neuroimaging-based biomarkers in psychiatric conditions, including schizophrenia. These approaches consider the complex pattern of alterations in brain function and structure, overcoming the limitations of traditional univariate methods. To assess the reliability of neuroimaging-based biomarkers and the contribution of study characteristics in distinguishing individuals with schizophrenia spectrum disorder (SSD) from healthy controls (HCs), we conducted a systematic review of the studies that used multivariate pattern recognition for this objective. METHODS We systematically searched PubMed, Scopus, and Web of Science for studies on SSD classification using multivariate pattern analysis on magnetic resonance imaging data. We employed a bivariate random-effects meta-analytic model to explore the classification of sensitivity (SE) and specificity (SP) across studies while also evaluating the moderator effects of clinical and non-clinical variables. RESULTS A total of 119 studies (with 12,723 patients with SSD and 13,196 HCs) were identified. The meta-analysis estimated a SE of 79.1% (95% confidence interval [CI], 77.1%-81.0%) and a SP of 80.0% (95% CI, 77.8%-82.0%). In particular, the Positive and Negative Syndrome Scale and the Global Assessment of Functioning scores, age, age of onset, duration of untreated psychosis, deep learning, algorithm type, features selection, and validation methods had significant effects on classification performance. CONCLUSIONS Multivariate pattern analysis reliably identifies neuroimaging-based biomarkers of SSD, achieving ∼80% SE and SP. Despite clinical heterogeneity, discernible brain modifications effectively differentiate SSD from HCs. Classification performance depends on patient-related and methodological factors crucial for the development, validation, and application of prospective models in clinical settings.
Collapse
Affiliation(s)
- Fabio Di Camillo
- Department of Neuroscience (DNS), University of Padova, Padua, Italy
| | | | - Giulia Cattarinussi
- Department of Neuroscience (DNS), University of Padova, Padua, Italy
- Padova Neuroscience Center, University of Padova, Padua, Italy
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Annabella Di Giorgio
- Department of Mental Health and Addictions, ASST Papa Giovanni XXIII, Bergamo, Italy
| | - Clara Locatelli
- Department of Mental Health and Addictions, ASST Papa Giovanni XXIII, Bergamo, Italy
| | - Adyasha Khuntia
- Department of Psychiatry and Psychotherapy, Ludwig-Maximilian University, Munich, Germany
- International Max Planck Research School for Translational Psychiatry (IMPRS-TP), Munich, Germany
- Max-Planck-Institute of Psychiatry, Munich, Germany
| | - Paolo Enrico
- Department of Psychiatry and Psychotherapy, Ludwig-Maximilian University, Munich, Germany
- Department of Pathophysiology and Transplantation, University of Milan, Milan, Italy
- Department of Neurosciences and Mental Health, Fondazione IRCSS Ca' Granda Ospedale Maggiore Policlinico, Milan, Italy
| | - Paolo Brambilla
- Department of Pathophysiology and Transplantation, University of Milan, Milan, Italy
- Department of Neurosciences and Mental Health, Fondazione IRCSS Ca' Granda Ospedale Maggiore Policlinico, Milan, Italy
| | - Nikolaos Koutsouleris
- Max-Planck-Institute of Psychiatry, Munich, Germany
- Department of Psychiatry, Munich University Hospital, Munich, Germany
- Department of Psychosis Studies, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Fabio Sambataro
- Department of Neuroscience (DNS), University of Padova, Padua, Italy
- Padova Neuroscience Center, University of Padova, Padua, Italy
| |
Collapse
|
3
|
Bang M, Park K, Choi SH, Ahn SS, Kim J, Lee SK, Park YW, Lee SH. Identification of schizophrenia by applying interpretable radiomics modeling with structural magnetic resonance imaging of the cerebellum. Psychiatry Clin Neurosci 2024; 78:527-535. [PMID: 38953397 DOI: 10.1111/pcn.13707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/10/2023] [Revised: 05/26/2024] [Accepted: 06/12/2024] [Indexed: 07/04/2024]
Abstract
AIMS The cerebellum is involved in higher-order mental processing as well as sensorimotor functions. Although structural abnormalities in the cerebellum have been demonstrated in schizophrenia, neuroimaging techniques are not yet applicable to identify them given the lack of biomarkers. We aimed to develop a robust diagnostic model for schizophrenia using radiomic features from T1-weighted magnetic resonance imaging (T1-MRI) of the cerebellum. METHODS A total of 336 participants (174 schizophrenia; 162 healthy controls [HCs]) were allocated to training (122 schizophrenia; 115 HCs) and test (52 schizophrenia; 47 HCs) cohorts. We obtained 2568 radiomic features from T1-MRI of the cerebellar subregions. After feature selection, a light gradient boosting machine classifier was trained. The discrimination and calibration of the model were evaluated. SHapley Additive exPlanations (SHAP) was applied to determine model interpretability. RESULTS We identified 17 radiomic features to differentiate participants with schizophrenia from HCs. In the test cohort, the radiomics model had an area under the curve, accuracy, sensitivity, and specificity of 0.89 (95% confidence interval: 0.82-0.95), 78.8%, 88.5%, and 75.4%, respectively. The model explanation by SHAP suggested that the second-order size zone non-uniformity feature from the right lobule IX and first-order energy feature from the right lobules V and VI were highly associated with the risk of schizophrenia. CONCLUSION The radiomics model focused on the cerebellum demonstrates robustness in diagnosing schizophrenia. Our results suggest that microcircuit disruption in the posterior cerebellum is a disease-defining feature of schizophrenia, and radiomics modeling has potential for supporting biomarker-based decision-making in clinical practice.
Collapse
Affiliation(s)
- Minji Bang
- Department of Psychiatry, CHA Bundang Medical Center, CHA University School of Medicine, Seongnam, Republic of Korea
| | - Kisung Park
- Department of Mechanical Engineering, Pohang University of Science and Technology, Pohang, Republic of Korea
| | - Seoung-Ho Choi
- National Program Excellence in Software at Kwangwoon University, Seoul, Republic of Korea
| | - Sung Soo Ahn
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Jinna Kim
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Seung-Koo Lee
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Yae Won Park
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Sang-Hyuk Lee
- Department of Psychiatry, CHA Bundang Medical Center, CHA University School of Medicine, Seongnam, Republic of Korea
| |
Collapse
|
4
|
Chatterjee S, Mishra J, Sundram F, Roop P. Towards Personalised Mood Prediction and Explanation for Depression from Biophysical Data. SENSORS (BASEL, SWITZERLAND) 2023; 24:164. [PMID: 38203024 PMCID: PMC10781272 DOI: 10.3390/s24010164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 11/30/2023] [Accepted: 12/19/2023] [Indexed: 01/12/2024]
Abstract
Digital health applications using Artificial Intelligence (AI) are a promising opportunity to address the widening gap between available resources and mental health needs globally. Increasingly, passively acquired data from wearables are augmented with carefully selected active data from depressed individuals to develop Machine Learning (ML) models of depression based on mood scores. However, most ML models are black box in nature, and hence the outputs are not explainable. Depression is also multimodal, and the reasons for depression may vary significantly between individuals. Explainable and personalised models will thus be beneficial to clinicians to determine the main features that lead to a decline in the mood state of a depressed individual, thus enabling suitable personalised therapy. This is currently lacking. Therefore, this study presents a methodology for developing personalised and accurate Deep Learning (DL)-based predictive mood models for depression, along with novel methods for identifying the key facets that lead to the exacerbation of depressive symptoms. We illustrate our approach by using an existing multimodal dataset containing longitudinal Ecological Momentary Assessments of depression, lifestyle data from wearables and neurocognitive assessments for 14 mild to moderately depressed participants over one month. We develop classification- and regression-based DL models to predict participants' current mood scores-a discrete score given to a participant based on the severity of their depressive symptoms. The models are trained inside eight different evolutionary-algorithm-based optimisation schemes that optimise the model parameters for a maximum predictive performance. A five-fold cross-validation scheme is used to verify the DL model's predictive performance against 10 classical ML-based models, with a model error as low as 6% for some participants. We use the best model from the optimisation process to extract indicators, using SHAP, ALE and Anchors from explainable AI literature to explain why certain predictions are made and how they affect mood. These feature insights can assist health professionals in incorporating personalised interventions into a depressed individual's treatment regimen.
Collapse
Affiliation(s)
- Sobhan Chatterjee
- Department of Electrical, Computer and Software Engineering, Faculty of Engineering, University of Auckland, Auckland 1010, New Zealand
| | - Jyoti Mishra
- Neural Engineering and Translation Labs, Department of Psychiatry, University of California, San Diego, CA 92093, USA;
| | - Frederick Sundram
- Department of Psychological Medicine, Faculty of Medical and Health Sciences, University of Auckland, Auckland 1023, New Zealand;
| | - Partha Roop
- Department of Electrical, Computer and Software Engineering, Faculty of Engineering, University of Auckland, Auckland 1010, New Zealand
| |
Collapse
|
5
|
Moon SY, Park H, Lee W, Lee S, Lho SK, Kim M, Kim KW, Kwon JS. Magnetic resonance texture analysis reveals stagewise nonlinear alterations of the frontal gray matter in patients with early psychosis. Mol Psychiatry 2023; 28:5309-5318. [PMID: 37500824 DOI: 10.1038/s41380-023-02163-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 06/13/2023] [Accepted: 06/23/2023] [Indexed: 07/29/2023]
Abstract
Although gray matter (GM) abnormalities are present from the early stages of psychosis, subtle/miniscule changes may not be detected by conventional volumetry. Texture analysis (TA), which permits quantification of the complex interrelationship between contrasts at the individual voxel level, may capture subtle GM changes with more sensitivity than does volume or cortical thickness (CTh). We performed three-dimensional TA in nine GM regions of interest (ROIs) using T1 magnetic resonance images from 101 patients with first-episode psychosis (FEP), 85 patients at clinical high risk (CHR) for psychosis, and 147 controls. Via principal component analysis, three features of gray-level cooccurrence matrix - informational measure of correlation 1 (IMC1), autocorrelation (AC), and inverse difference (ID) - were selected to analyze cortical texture in the ROIs that showed a significant change in volume or CTh in the study groups. Significant reductions in GM volume and CTh of various frontotemporal regions were found in the FEP compared with the controls. Increased frontal AC was found in the FEP group compared to the controls after adjusting for volume and CTh changes. While volume and CTh were preserved in the CHR group, a stagewise nonlinear increase in frontal IMC1 was found, which exceeded both the controls and FEP group. Increased frontal IMC1 was also associated with a lesser severity of attenuated positive symptoms in the CHR group, while neither volume nor CTh was. The results of the current study suggest that frontal IMC1 may reflect subtle, dynamic GM changes and the symptomatology of the CHR stage with greater sensitivity, even in the absence of gross GM abnormalities. Some structural mechanisms that may contribute to texture changes (e.g., macrostructural cortical lamina, neuropil/myelination, cortical reorganization) and their possible implications are explored and discussed. Texture may be a useful tool to investigate subtle and dynamic GM abnormalities, especially during the CHR period.
Collapse
Affiliation(s)
- Sun Young Moon
- Department of Public Health Service, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
- Institute of Human Behavioral Medicine, Seoul National University Medical Research Center, Seoul, Republic of Korea
| | - Hyungyou Park
- Department of Brain and Cognitive Science, Seoul National University College of Natural Science, Seoul, Republic of Korea
| | - Won Lee
- Department of Brain and Cognitive Science, Seoul National University College of Natural Science, Seoul, Republic of Korea
| | - Subin Lee
- Department of Brain and Cognitive Science, Seoul National University College of Natural Science, Seoul, Republic of Korea
| | | | - Minah Kim
- Department of Neuropsychiatry, Seoul National University Hospital, Seoul, Republic of Korea
- Department of Psychiatry, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Ki Woong Kim
- Institute of Human Behavioral Medicine, Seoul National University Medical Research Center, Seoul, Republic of Korea
- Department of Brain and Cognitive Science, Seoul National University College of Natural Science, Seoul, Republic of Korea
- Department of Psychiatry, Seoul National University College of Medicine, Seoul, Republic of Korea
- Department of Neuropsychiatry, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Jun Soo Kwon
- Institute of Human Behavioral Medicine, Seoul National University Medical Research Center, Seoul, Republic of Korea.
- Department of Brain and Cognitive Science, Seoul National University College of Natural Science, Seoul, Republic of Korea.
- Department of Neuropsychiatry, Seoul National University Hospital, Seoul, Republic of Korea.
- Department of Psychiatry, Seoul National University College of Medicine, Seoul, Republic of Korea.
| |
Collapse
|