1
|
Liu H, Lao M, Zhang Y, Chang C, Yin Y, Wang R. Radiomics-based machine learning models for differentiating pathological subtypes in cervical cancer: a multicenter study. Front Oncol 2024; 14:1346336. [PMID: 39355130 PMCID: PMC11442173 DOI: 10.3389/fonc.2024.1346336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Accepted: 08/27/2024] [Indexed: 10/03/2024] Open
Abstract
Purpose This study was designed to determine the diagnostic performance of fluorine-18-fluorodeoxyglucose (18F-FDG) positron emission tomography (PET)/computed tomography (CT) radiomics-based machine learning (ML) in the classification of cervical adenocarcinoma (AC) and squamous cell carcinoma (SCC). Methods Pretreatment 18F-FDG PET/CT data were retrospectively collected from patients who were diagnosed with locally advanced cervical cancer at two centers. Radiomics features were extracted and selected by the Pearson correlation coefficient and least absolute shrinkage and selection operator regression analysis. Six ML algorithms were then applied to establish models, and the best-performing classifier was selected based on accuracy, sensitivity, specificity, and area under the curve (AUC). The performance of different model was assessed and compared using the DeLong test. Results A total of 227 patients with locally advanced cervical cancer were enrolled in this study (N=136 for the training cohort, N=59 for the internal validation cohort, and N=32 for the external validation cohort). The PET radiomics model constructed based on the lightGBM algorithm had an accuracy of 0.915 and an AUC of 0.851 (95% confidence interval [CI], 0.715-0.986) in the internal validation cohort, which were higher than those of the CT radiomics model (accuracy: 0.661; AUC: 0.513 [95% CI, 0.339-0.688]). The DeLong test revealed no significant difference in AUC between the combined radiomics model and the PET radiomics model in either the training cohort (z=0.940, P=0.347) or the internal validation cohort (z=0.285, P=0.776). In the external validation cohort, the lightGBM-based PET radiomics model achieved good discrimination between SCC and AC (AUC = 0.730). Conclusions The lightGBM-based PET radiomics model had great potential to predict the fine histological subtypes of locally advanced cervical cancer and might serve as a promising noninvasive approach for the diagnosis and management of locally advanced cervical cancer.
Collapse
Affiliation(s)
- Huiling Liu
- Department of Radiation Oncology, The Third Affiliated Teaching Hospital of Xinjiang Medical University, Affiliated Cancer Hospital, Urumuqi, China
- Department of Radiation Oncology, Binzhou People’s Hospital, Binzhou, China
| | - Mi Lao
- Department of Cardiology, Binzhou People’s Hospital, Binzhou, China
| | - Yalin Zhang
- Department of Radiation Oncology, The Third Affiliated Teaching Hospital of Xinjiang Medical University, Affiliated Cancer Hospital, Urumuqi, China
| | - Cheng Chang
- Department of Nuclear Medicine, The Third Affiliated Teaching Hospital of Xinjiang Medical University, Affiliated Cancer Hospital, Urumuqi, China
| | - Yong Yin
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, China
| | - Ruozheng Wang
- Department of Radiation Oncology, The Third Affiliated Teaching Hospital of Xinjiang Medical University, Affiliated Cancer Hospital, Urumuqi, China
- Key Laboratory of Oncology of Xinjiang Uyghur Autonomous Region, Urumuqi, China
- Clinical Key Specialty of Radiotherapy of Xinjiang Uygur Autonomous Region, Urumuqi, China
| |
Collapse
|
2
|
Demuth S, Paris J, Faddeenkov I, De Sèze J, Gourraud PA. Clinical applications of deep learning in neuroinflammatory diseases: A scoping review. Rev Neurol (Paris) 2024:S0035-3787(24)00522-8. [PMID: 38772806 DOI: 10.1016/j.neurol.2024.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Revised: 03/26/2024] [Accepted: 04/09/2024] [Indexed: 05/23/2024]
Abstract
BACKGROUND Deep learning (DL) is an artificial intelligence technology that has aroused much excitement for predictive medicine due to its ability to process raw data modalities such as images, text, and time series of signals. OBJECTIVES Here, we intend to give the clinical reader elements to understand this technology, taking neuroinflammatory diseases as an illustrative use case of clinical translation efforts. We reviewed the scope of this rapidly evolving field to get quantitative insights about which clinical applications concentrate the efforts and which data modalities are most commonly used. METHODS We queried the PubMed database for articles reporting DL algorithms for clinical applications in neuroinflammatory diseases and the radiology.healthairegister.com website for commercial algorithms. RESULTS The review included 148 articles published between 2018 and 2024 and five commercial algorithms. The clinical applications could be grouped as computer-aided diagnosis, individual prognosis, functional assessment, the segmentation of radiological structures, and the optimization of data acquisition. Our review highlighted important discrepancies in efforts. The segmentation of radiological structures and computer-aided diagnosis currently concentrate most efforts with an overrepresentation of imaging. Various model architectures have addressed different applications, relatively low volume of data, and diverse data modalities. We report the high-level technical characteristics of the algorithms and synthesize narratively the clinical applications. Predictive performances and some common a priori on this topic are finally discussed. CONCLUSION The currently reported efforts position DL as an information processing technology, enhancing existing modalities of paraclinical investigations and bringing perspectives to make innovative ones actionable for healthcare.
Collapse
Affiliation(s)
- S Demuth
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France; Inserm U1119 : biopathologie de la myéline, neuroprotection et stratégies thérapeutiques, University of Strasbourg, 1, rue Eugène-Boeckel - CS 60026, 67084 Strasbourg, France.
| | - J Paris
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France
| | - I Faddeenkov
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France
| | - J De Sèze
- Inserm U1119 : biopathologie de la myéline, neuroprotection et stratégies thérapeutiques, University of Strasbourg, 1, rue Eugène-Boeckel - CS 60026, 67084 Strasbourg, France; Department of Neurology, University Hospital of Strasbourg, 1, avenue Molière, 67200 Strasbourg, France; Inserm CIC 1434 Clinical Investigation Center, University Hospital of Strasbourg, 1, avenue Molière, 67200 Strasbourg, France
| | - P-A Gourraud
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France; "Data clinic", Department of Public Health, University Hospital of Nantes, Nantes, France
| |
Collapse
|
3
|
Chang CC, Lin CY, Liu YS, Chen YY, Huang WL, Lai WW, Yen YT, Ma MC, Tseng YL. Therapeutic Decision Making in Prevascular Mediastinal Tumors Using CT Radiomics and Clinical Features: Upfront Surgery or Pretreatment Needle Biopsy? Cancers (Basel) 2024; 16:773. [PMID: 38398164 PMCID: PMC10886806 DOI: 10.3390/cancers16040773] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Revised: 02/08/2024] [Accepted: 02/09/2024] [Indexed: 02/25/2024] Open
Abstract
The study aimed to develop machine learning (ML) classification models for differentiating patients who needed direct surgery from patients who needed core needle biopsy among patients with prevascular mediastinal tumor (PMT). Patients with PMT who received a contrast-enhanced computed tomography (CECT) scan and initial management for PMT between January 2010 and December 2020 were included in this retrospective study. Fourteen ML algorithms were used to construct candidate classification models via the voting ensemble approach, based on preoperative clinical data and radiomic features extracted from the CECT. The classification accuracy of clinical diagnosis was 86.1%. The first ensemble learning model was built by randomly choosing seven ML models from a set of fourteen ML models and had a classification accuracy of 88.0% (95% CI = 85.8 to 90.3%). The second ensemble learning model was the combination of five ML models, including NeuralNetFastAI, NeuralNetTorch, RandomForest with Entropy, RandomForest with Gini, and XGBoost, and had a classification accuracy of 90.4% (95% CI = 87.9 to 93.0%), which significantly outperformed clinical diagnosis (p < 0.05). Due to the superior performance, the voting ensemble learning clinical-radiomic classification model may be used as a clinical decision support system to facilitate the selection of the initial management of PMT.
Collapse
Affiliation(s)
- Chao-Chun Chang
- Division of Thoracic Surgery, Department of Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan 704302, Taiwan; (C.-C.C.); (Y.-Y.C.); (W.-L.H.); (W.-W.L.); (Y.-L.T.)
| | - Chia-Ying Lin
- Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan 704302, Taiwan; (C.-Y.L.); (Y.-S.L.)
| | - Yi-Sheng Liu
- Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan 704302, Taiwan; (C.-Y.L.); (Y.-S.L.)
| | - Ying-Yuan Chen
- Division of Thoracic Surgery, Department of Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan 704302, Taiwan; (C.-C.C.); (Y.-Y.C.); (W.-L.H.); (W.-W.L.); (Y.-L.T.)
| | - Wei-Li Huang
- Division of Thoracic Surgery, Department of Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan 704302, Taiwan; (C.-C.C.); (Y.-Y.C.); (W.-L.H.); (W.-W.L.); (Y.-L.T.)
| | - Wu-Wei Lai
- Division of Thoracic Surgery, Department of Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan 704302, Taiwan; (C.-C.C.); (Y.-Y.C.); (W.-L.H.); (W.-W.L.); (Y.-L.T.)
- Division of Thoracic Surgery, Department of Surgery, An-Nan Hospital, China Medical University, Tainan 70965, Taiwan
| | - Yi-Ting Yen
- Division of Thoracic Surgery, Department of Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan 704302, Taiwan; (C.-C.C.); (Y.-Y.C.); (W.-L.H.); (W.-W.L.); (Y.-L.T.)
- Division of Trauma and Acute Care Surgery, Department of Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan 704302, Taiwan
| | - Mi-Chia Ma
- Department of Statistics and Institute of Data Science, National Cheng Kung University, Tainan 701401, Taiwan
| | - Yau-Lin Tseng
- Division of Thoracic Surgery, Department of Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan 704302, Taiwan; (C.-C.C.); (Y.-Y.C.); (W.-L.H.); (W.-W.L.); (Y.-L.T.)
| |
Collapse
|
4
|
Strotzer QD, Wagner T, Angstwurm P, Hense K, Scheuermeyer L, Noeva E, Dinkel J, Stroszczynski C, Fellner C, Riemenschneider MJ, Rosengarth K, Pukrop T, Wiesinger I, Wendl C, Schicho A. Limited capability of MRI radiomics to predict primary tumor histology of brain metastases in external validation. Neurooncol Adv 2024; 6:vdae060. [PMID: 38800697 PMCID: PMC11125388 DOI: 10.1093/noajnl/vdae060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/29/2024] Open
Abstract
Background Growing research demonstrates the ability to predict histology or genetic information of various malignancies using radiomic features extracted from imaging data. This study aimed to investigate MRI-based radiomics in predicting the primary tumor of brain metastases through internal and external validation, using oversampling techniques to address the class imbalance. Methods This IRB-approved retrospective multicenter study included brain metastases from lung cancer, melanoma, breast cancer, colorectal cancer, and a combined heterogenous group of other primary entities (5-class classification). Local data were acquired between 2003 and 2021 from 231 patients (545 metastases). External validation was performed with 82 patients (280 metastases) and 258 patients (809 metastases) from the publicly available Stanford BrainMetShare and the University of California San Francisco Brain Metastases Stereotactic Radiosurgery datasets, respectively. Preprocessing included brain extraction, bias correction, coregistration, intensity normalization, and semi-manual binary tumor segmentation. Two-thousand five hundred and twenty-eight radiomic features were extracted from T1w (± contrast), fluid-attenuated inversion recovery (FLAIR), and wavelet transforms for each sequence (8 decompositions). Random forest classifiers were trained with selected features on original and oversampled data (5-fold cross-validation) and evaluated on internal/external holdout test sets using accuracy, precision, recall, F1 score, and area under the receiver-operating characteristic curve (AUC). Results Oversampling did not improve the overall unsatisfactory performance on the internal and external test sets. Incorrect data partitioning (oversampling before train/validation/test split) leads to a massive overestimation of model performance. Conclusions Radiomics models' capability to predict histologic or genomic data from imaging should be critically assessed; external validation is essential.
Collapse
Affiliation(s)
- Quirin D Strotzer
- Department of Radiology, University Medical Center Regensburg, Regensburg, Germany
- Division of Neuroradiology, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Thomas Wagner
- Department of Radiology, University Medical Center Regensburg, Regensburg, Germany
| | - Pia Angstwurm
- Department of Radiology, University Medical Center Regensburg, Regensburg, Germany
| | - Katharina Hense
- Department of Neurosurgery, University Medical Center Regensburg, Regensburg, Germany
| | - Lucca Scheuermeyer
- Department of Radiology, University Medical Center Regensburg, Regensburg, Germany
| | - Ekaterina Noeva
- Department of Radiology, University Medical Center Regensburg, Regensburg, Germany
| | - Johannes Dinkel
- Department of Radiology, University Medical Center Regensburg, Regensburg, Germany
| | | | - Claudia Fellner
- Department of Radiology, University Medical Center Regensburg, Regensburg, Germany
| | | | - Katharina Rosengarth
- Department of Neurosurgery, University Medical Center Regensburg, Regensburg, Germany
| | - Tobias Pukrop
- Department of Internal Medicine III—Hematology and Oncology, University Medical Center Regensburg, Regensburg, Germany
| | - Isabel Wiesinger
- Center of Neuroradiology, medbo District Hospital and University Medical Center Regensburg, Regensburg, Germany
| | - Christina Wendl
- Department of Radiology, University Medical Center Regensburg, Regensburg, Germany
- Center of Neuroradiology, medbo District Hospital and University Medical Center Regensburg, Regensburg, Germany
| | - Andreas Schicho
- Department of Radiology, University Medical Center Regensburg, Regensburg, Germany
| |
Collapse
|