1
|
Wang J, Song P, Zhang M, Liu W, Zeng X, Chen N, Li Y, Wang M. A prediction model based on deep learning and radiomics features of DWI for the assessment of microsatellite instability in endometrial cancer. Cancer Med 2024; 13:e70046. [PMID: 39171859 PMCID: PMC11339853 DOI: 10.1002/cam4.70046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2024] [Revised: 07/06/2024] [Accepted: 07/12/2024] [Indexed: 08/23/2024] Open
Abstract
BACKGROUND To explore the efficacy of a prediction model based on diffusion-weighted imaging (DWI) features extracted from deep learning (DL) and radiomics combined with clinical parameters and apparent diffusion coefficient (ADC) values to identify microsatellite instability (MSI) in endometrial cancer (EC). METHODS This study included a cohort of 116 patients with EC, who were subsequently divided into training (n = 81) and test (n = 35) sets. From DWI, conventional radiomics features and convolutional neural network-based DL features were extracted. Random forest (RF) and logistic regression were adopted as classifiers. DL features, radiomics features, clinical variables, ADC values, and their combinations were applied to establish DL, radiomics, clinical, ADC, and combined models, respectively. The predictive performance was evaluated through the area under the receiver operating characteristic curve (AUC), total integrated discrimination index (IDI), net reclassification index (NRI), calibration curves, and decision curve analysis (DCA). RESULTS The optimal predictive model, based on an RF classifier, comprised four DL features, three radiomics features, two clinical variables, and an ADC value. In the training and test sets, this model exhibited AUC values of 0.989 (95% CI: 0.935-1.000) and 0.885 (95% CI: 0.731-0.967), respectively, demonstrating different degrees of improvement compared with the clinical, DL, radiomics, and ADC models (AUC-training = 0.671, 0.873, 0.833, and 0.814, AUC-test = 0.685, 0.783, 0.708, and 0.713, respectively). The NRI and IDI analyses revealed that the combined model resulted in improved risk reclassification of the MSI status compared to the clinical, radiomics, DL, and ADC models. The calibration curves and DCA indicated good consistency and clinical utility of this model, respectively. CONCLUSIONS The predictive model based on DWI features extracted from DL and radiomics combined with clinical parameters and ADC values could effectively assess the MSI status in EC.
Collapse
Affiliation(s)
- Jing Wang
- Department of Nuclear MedicineThe Affiliated Hospital of Guizhou Medical UniversityGuiyangChina
| | - Pujiao Song
- Department of Nuclear MedicineThe Affiliated Hospital of Guizhou Medical UniversityGuiyangChina
| | - Meng Zhang
- Department of Magnetic Resonance ImagingThe First Affiliated Hospital of Xinxiang Medical UniversityXinxiangChina
| | - Wei Liu
- Department of Nuclear MedicineThe Affiliated Hospital of Guizhou Medical UniversityGuiyangChina
| | - Xi Zeng
- Department of Nuclear MedicineThe Affiliated Hospital of Guizhou Medical UniversityGuiyangChina
| | - Nanshan Chen
- Department of Nuclear MedicineThe Affiliated Hospital of Guizhou Medical UniversityGuiyangChina
| | - Yuxia Li
- Department of Magnetic Resonance ImagingThe First Affiliated Hospital of Xinxiang Medical UniversityXinxiangChina
| | - Minghua Wang
- Department of Nuclear MedicineThe Affiliated Hospital of Guizhou Medical UniversityGuiyangChina
| |
Collapse
|
2
|
Russo L, Bottazzi S, Kocak B, Zormpas-Petridis K, Gui B, Stanzione A, Imbriaco M, Sala E, Cuocolo R, Ponsiglione A. Evaluating the quality of radiomics-based studies for endometrial cancer using RQS and METRICS tools. Eur Radiol 2024:10.1007/s00330-024-10947-6. [PMID: 39014086 DOI: 10.1007/s00330-024-10947-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2024] [Revised: 05/15/2024] [Accepted: 06/19/2024] [Indexed: 07/18/2024]
Abstract
OBJECTIVE To assess the methodological quality of radiomics-based models in endometrial cancer using the radiomics quality score (RQS) and METhodological radiomICs score (METRICS). METHODS We systematically reviewed studies published by October 30th, 2023. Inclusion criteria were original radiomics studies on endometrial cancer using CT, MRI, PET, or ultrasound. Articles underwent a quality assessment by novice and expert radiologists using RQS and METRICS. The inter-rater reliability for RQS and METRICS among radiologists with varying expertise was determined. Subgroup analyses were performed to assess whether scores varied according to study topic, imaging technique, publication year, and journal quartile. RESULTS Sixty-eight studies were analysed, with a median RQS of 11 (IQR, 9-14) and METRICS score of 67.6% (IQR, 58.8-76.0); two different articles reached maximum RQS of 19 and METRICS of 90.7%, respectively. Most studies utilised MRI (82.3%) and machine learning methods (88.2%). Characterisation and recurrence risk stratification were the most explored outcomes, featured in 35.3% and 19.1% of articles, respectively. High inter-rater reliability was observed for both RQS (ICC: 0.897; 95% CI: 0.821, 0.946) and METRICS (ICC: 0.959; 95% CI: 0.928, 0.979). Methodological limitations such as lack of external validation suggest areas for improvement. At subgroup analyses, no statistically significant difference was noted. CONCLUSIONS Whilst using RQS, the quality of endometrial cancer radiomics research was apparently unsatisfactory, METRICS depicts a good overall quality. Our study highlights the need for strict compliance with quality metrics. Adhering to these quality measures can increase the consistency of radiomics towards clinical application in the pre-operative management of endometrial cancer. CLINICAL RELEVANCE STATEMENT Both the RQS and METRICS can function as instrumental tools for identifying different methodological deficiencies in endometrial cancer radiomics research. However, METRICS also reflected a focus on the practical applicability and clarity of documentation. KEY POINTS The topic of radiomics currently lacks standardisation, limiting clinical implementation. METRICS scores were generally higher than the RQS, reflecting differences in the development process and methodological content. A positive trend in METRICS score may suggest growing attention to methodological aspects in radiomics research.
Collapse
Affiliation(s)
- Luca Russo
- Dipartimento di Scienze Radiologiche ed Ematologiche, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Silvia Bottazzi
- Dipartimento di Scienze Radiologiche ed Ematologiche, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Burak Kocak
- Department of Radiology, University of Health Sciences, Basaksehir Cam and Sakura City Hospital, Basaksehir, Istanbul, Turkey
| | - Konstantinos Zormpas-Petridis
- Dipartimento Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy
| | - Benedetta Gui
- Dipartimento Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy
| | - Arnaldo Stanzione
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Naples, Italy
| | - Massimo Imbriaco
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Naples, Italy
| | - Evis Sala
- Dipartimento di Scienze Radiologiche ed Ematologiche, Università Cattolica del Sacro Cuore, Rome, Italy
- Dipartimento Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy
| | - Renato Cuocolo
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy.
| | - Andrea Ponsiglione
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Naples, Italy
| |
Collapse
|
3
|
Fang Y, Wei Y, Liu X, Qin L, Gao Y, Yu Z, Xu X, Cha G, Zhu X, Wang X, Xu L, Cao L, Chen X, Jiang H, Zhang C, Zhou Y, Zhu J. A self-supervised classification model for endometrial diseases. J Cancer Res Clin Oncol 2023; 149:17855-17863. [PMID: 37947870 PMCID: PMC10725391 DOI: 10.1007/s00432-023-05467-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Accepted: 10/09/2023] [Indexed: 11/12/2023]
Abstract
PURPOSE Ultrasound imaging is the preferred method for the early diagnosis of endometrial diseases because of its non-invasive nature, low cost, and real-time imaging features. However, the accurate evaluation of ultrasound images relies heavily on the experience of radiologist. Therefore, a stable and objective computer-aided diagnostic model is crucial to assist radiologists in diagnosing endometrial lesions. METHODS Transvaginal ultrasound images were collected from multiple hospitals in Quzhou city, Zhejiang province. The dataset comprised 1875 images from 734 patients, including cases of endometrial polyps, hyperplasia, and cancer. Here, we proposed a based self-supervised endometrial disease classification model (BSEM) that learns a joint unified task (raw and self-supervised tasks) and applies self-distillation techniques and ensemble strategies to aid doctors in diagnosing endometrial diseases. RESULTS The performance of BSEM was evaluated using fivefold cross-validation. The experimental results indicated that the BSEM model achieved satisfactory performance across indicators, with scores of 75.1%, 87.3%, 76.5%, 73.4%, and 74.1% for accuracy, area under the curve, precision, recall, and F1 score, respectively. Furthermore, compared to the baseline models ResNet, DenseNet, VGGNet, ConvNeXt, VIT, and CMT, the BSEM model enhanced accuracy, area under the curve, precision, recall, and F1 score in 3.3-7.9%, 3.2-7.3%, 3.9-8.5%, 3.1-8.5%, and 3.3-9.0%, respectively. CONCLUSION The BSEM model is an auxiliary diagnostic tool for the early detection of endometrial diseases revealed by ultrasound and helps radiologists to be accurate and efficient while screening for precancerous endometrial lesions.
Collapse
Affiliation(s)
- Yun Fang
- Quzhou People's Hospital, The Quzhou Affiliated Hospital of Wenzhou Medical University, Quzhou, 324000, Zhejiang, China
| | - Yanmin Wei
- Tianjin Normal University, Tianjin, 300387, China
| | - Xiaoying Liu
- Quzhou People's Hospital, The Quzhou Affiliated Hospital of Wenzhou Medical University, Quzhou, 324000, Zhejiang, China
| | - Liufeng Qin
- Quzhou People's Hospital, The Quzhou Affiliated Hospital of Wenzhou Medical University, Quzhou, 324000, Zhejiang, China
| | - Yunxia Gao
- The Second People's Hospital of Quzhou, Quzhou, 324000, Zhejiang, China
| | - Zhengjun Yu
- Kaihua County People's Hospital, Quzhou, 324300, Zhejiang, China
| | - Xia Xu
- Changshan County People's Hospital, Quzhou, 324200, Zhejiang, China
| | - Guofen Cha
- People's Hospital of Quzhou Kecheng, Quzhou, 324000, Zhejiang, China
| | - Xuehua Zhu
- Quzhou Maternal and Child Health Care Hospital, Quzhou, 324000, Zhejiang, China
| | - Xue Wang
- Quzhou People's Hospital, The Quzhou Affiliated Hospital of Wenzhou Medical University, Quzhou, 324000, Zhejiang, China
| | - Lijuan Xu
- Quzhou People's Hospital, The Quzhou Affiliated Hospital of Wenzhou Medical University, Quzhou, 324000, Zhejiang, China
| | - Lulu Cao
- Quzhou People's Hospital, The Quzhou Affiliated Hospital of Wenzhou Medical University, Quzhou, 324000, Zhejiang, China
| | - Xiangrui Chen
- Changshan County People's Hospital, Quzhou, 324200, Zhejiang, China
| | - Haixia Jiang
- Kaihua County People's Hospital, Quzhou, 324300, Zhejiang, China
| | - Chaozhen Zhang
- People's Hospital of Quzhou Kecheng, Quzhou, 324000, Zhejiang, China
| | - Yuwang Zhou
- Quzhou People's Hospital, The Quzhou Affiliated Hospital of Wenzhou Medical University, Quzhou, 324000, Zhejiang, China.
| | - Jinqi Zhu
- Tianjin Normal University, Tianjin, 300387, China.
| |
Collapse
|
4
|
Kim JK, Choi GS, Kwak SY, Chang MC. Convolutional Neural Network Algorithm Trained with Anteroposterior Radiographs to Diagnose Pre-Collapse Osteonecrosis of the Femoral Head. APPLIED SCIENCES 2022; 12:9606. [DOI: 10.3390/app12199606] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/13/2023]
Abstract
A convolutional neural network (CNN) is a representative deep-learning algorithm that has a significant advantage in image recognition and classification. Using anteroposterior pelvic radiographs as input data, we developed a CNN algorithm to determine the presence of pre-collapse osteonecrosis of the femoral head (ONFH). We developed a CNN algorithm to differentiate between ONFH and normal radiographs. We retrospectively included 305 anteroposterior pelvic radiographs (right hip: pre-collapsed ONFH = 79, normal = 226; left hip: pre-collapsed ONFH = 62, normal = 243) as data samples. Pre-collapsed ONFH was diagnosed using pelvic magnetic resonance imaging data for each patient. Among the 305 cases, 69.8% of the included data samples were randomly selected as the training set, 21.0% were selected as the validation set, and the remaining 9.2% were selected as the test set to evaluate the performance of the developed CNN algorithm. The area under the curve of our developed CNN algorithm on the test data was 0.912 (95% confidence interval, 0.773–1.000) for the right hip and 0.902 (95% confidence interval, 0.747–1.000) for the left hip. We showed that a CNN algorithm trained using pelvic radiographs would help diagnose pre-collapse ONFH.
Collapse
|