1
|
Santos CS, Amorim-Lopes M. Externally validated and clinically useful machine learning algorithms to support patient-related decision-making in oncology: a scoping review. BMC Med Res Methodol 2025; 25:45. [PMID: 39984835 PMCID: PMC11843972 DOI: 10.1186/s12874-025-02463-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Accepted: 01/03/2025] [Indexed: 02/23/2025] Open
Abstract
BACKGROUND This scoping review systematically maps externally validated machine learning (ML)-based models in cancer patient care, quantifying their performance, and clinical utility, and examining relationships between models, cancer types, and clinical decisions. By synthesizing evidence, this study identifies, strengths, limitations, and areas requiring further research. METHODS The review followed the Joanna Briggs Institute's methodology, Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines, and the Population, Concept, and Context mnemonic. Searches were conducted across Embase, IEEE Xplore, PubMed, Scopus, and Web of Science (January 2014-September 2022), targeting English-language quantitative studies in Q1 journals (SciMago Journal and Country Ranking > 1) that used ML to evaluate clinical outcomes for human cancer patients with commonly available data. Eligible models required external validation, clinical utility assessment, and performance metric reporting. Studies involving genetics, synthetic patients, plants, or animals were excluded. Results were presented in tabular, graphical, and descriptive form. RESULTS From 4023 deduplicated abstracts and 636 full-text reviews, 56 studies (2018-2022) met the inclusion criteria, covering diverse cancer types and applications. Convolutional neural networks were most prevalent, demonstrating high performance, followed by gradient- and decision tree-based algorithms. Other algorithms, though underrepresented, showed promise. Lung and digestive system cancers were most frequently studied, focusing on diagnosis and outcome predictions. Most studies were retrospective and multi-institutional, primarily using image-based data, followed by text-based and hybrid approaches. Clinical utility assessments involved 499 clinicians and 12 tools, indicating improved clinician performance with AI assistance and superior performance to standard clinical systems. DISCUSSION Interest in ML-based clinical decision-making has grown in recent years alongside increased multi-institutional collaboration. However, small sample sizes likely impacted data quality and generalizability. Persistent challenges include limited international validation across ethnicities, inconsistent data sharing, disparities in validation metrics, and insufficient calibration reporting, hindering model comparison reliability. CONCLUSION Successful integration of ML in oncology decision-making requires standardized data and methodologies, larger sample sizes, greater transparency, and robust validation and clinical utility assessments. OTHER Financed by FCT-Fundação para a Ciência e a Tecnologia (Portugal, project LA/P/0063/2020, grant 2021.09040.BD) as part of CSS's Ph.D. This work was not registered.
Collapse
Affiliation(s)
- Catarina Sousa Santos
- Institute for Systems and Computer Engineering, Technology and Science (INESC TEC), Porto, Portugal.
| | - Mário Amorim-Lopes
- Institute for Systems and Computer Engineering, Technology and Science (INESC TEC), Porto, Portugal
| |
Collapse
|
2
|
Akinci D'Antonoli T, Cavallo AU, Kocak B, Borgheresi A, Ponsiglione A, Stanzione A, Koltsakis E, Doniselli FM, Vernuccio F, Ugga L, Triantafyllou M, Huisman M, Klontzas ME, Trotta R, Cannella R, Fanni SC, Cuocolo R. Reproducibility of methodological radiomics score (METRICS): an intra- and inter-rater reliability study endorsed by EuSoMII. Eur Radiol 2025:10.1007/s00330-025-11443-1. [PMID: 39969552 DOI: 10.1007/s00330-025-11443-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2024] [Revised: 01/07/2025] [Accepted: 01/24/2025] [Indexed: 02/20/2025]
Abstract
OBJECTIVES To investigate the intra- and inter-rater reliability of the total methodological radiomics score (METRICS) and its items through a multi-reader analysis. MATERIALS AND METHODS A total of 12 raters with different backgrounds and experience levels were recruited for the study. Based on their level of expertise, raters were randomly assigned to the following groups: two inter-rater reliability groups, and two intra-rater reliability groups, where each group included one group with and one group without a preliminary training session on the use of METRICS. Inter-rater reliability groups assessed all 34 papers, while intra-rater reliability groups completed the assessment of 17 papers twice within 21 days each time, and a "wash out" period of 60 days in between. RESULTS Inter-rater reliability was poor to moderate between raters of group 1 (without training; ICC = 0.393; 95% CI = 0.115-0.630; p = 0.002), and between raters of group 2 (with training; ICC = 0.433; 95% CI = 0.127-0.671; p = 0.002). The intra-rater analysis was excellent for raters 9 and 12, good to excellent for raters 8 and 10, moderate to excellent for rater 7, and poor to good for rater 11. CONCLUSION The intra-rater reliability of the METRICS score was relatively good, while the inter-rater reliability was relatively low. This highlights the need for further efforts to achieve a common understanding of METRICS items, as well as resources consisting of explanations, elaborations, and examples to improve reproducibility and enhance their usability and robustness. KEY POINTS Questions Guidelines and scoring tools are necessary to improve the quality of radiomics research; however, the application of these tools is challenging for less experienced raters. Findings Intra-rater reliability was high across all raters regardless of experience level or previous training, and inter-rater reliability was generally poor to moderate across raters. Clinical relevance Guidelines and scoring tools are necessary for proper reporting in radiomics research and for closing the gap between research and clinical implementation. There is a need for further resources offering explanations, elaborations, and examples to enhance the usability and robustness of these guidelines.
Collapse
Affiliation(s)
- Tugba Akinci D'Antonoli
- Institute of Radiology and Nuclear Medicine, Cantonal Hospital Baselland, Liestal, Switzerland.
| | - Armando Ugo Cavallo
- Division of Radiology, Istituto Dermopatico dell'Immacolata (IDI), IRCCS, Rome, Italy
| | - Burak Kocak
- Department of Radiology, Basaksehir Cam and Sakura City Hospital, University of Health Sciences, Istanbul, Turkey
| | - Alessandra Borgheresi
- Department of Clinical, Special and Dental Sciences, University Politecnica delle Marche, Ancona, Italy
- Department of Radiology, University Hospital "Azienda Ospedaliero Universitaria delle Marche", Ancona, Italy
| | - Andrea Ponsiglione
- Department of Advanced Biomedical Sciences, University of Naples Federico II, Naples, Italy
| | - Arnaldo Stanzione
- Department of Advanced Biomedical Sciences, University of Naples Federico II, Naples, Italy
| | - Emmanouil Koltsakis
- Department of Radiology, Karolinska University Hospital of Stockholm, Stockholm, Sweden
- Division of Radiology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institute, Stockholm, Sweden
| | | | - Federica Vernuccio
- Department of Biomedicine, Neuroscience, and Advanced Diagnostics (Bi.N.D.), University of Palermo, Palermo, Italy
| | - Lorenzo Ugga
- Department of Advanced Biomedical Sciences, University of Naples Federico II, Naples, Italy
| | | | - Merel Huisman
- Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Michail E Klontzas
- Artificial Intelligence and Translational Imaging (ATI) Lab, Department of Radiology, School of Medicine, University of Crete, Heraklion, Greece
- Computational Biomedicine Lab, Institute of Computer Science, Foundation for Research and Technology (ICS-FORTH), Crete, Greece
- Division of Radiology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institute, Stockholm, Sweden
| | - Romina Trotta
- Department of Radiology, Santa Clotilde's Hospital, Santander, Spain
| | - Roberto Cannella
- Department of Biomedicine, Neuroscience, and Advanced Diagnostics (Bi.N.D.), University of Palermo, Palermo, Italy
| | | | - Renato Cuocolo
- Department of Medicine, Surgery, and Dentistry, University of Salerno, Fisciano, Italy
| |
Collapse
|
3
|
Dalai SS, Ranjan Sahu BJ, Rautaray J, Khan MI, Jabr BA, Ali YA. Automated Bone Cancer Detection Using Deep Learning on X-Ray Images. Surg Innov 2024:15533506241299886. [PMID: 39679470 DOI: 10.1177/15533506241299886] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2024]
Abstract
In recent days, bone cancer is a life-threatening health issue that can lead to death. However, physicians use CT-scan, X-rays, or MRI images to recognize bone cancer, but still require techniques to increase precision and reduce human labor. These methods face challenges such as high costs, time consumption, and the risk of misdiagnosis due to the complexity of bone tumor appearances. Therefore, it is essential to establish an automated system to detect healthy bones from cancerous ones. In this regard, Artificial intelligence, particularly deep learning, shows increased attention in the medical image analysis process. This research presents a new Golden Search Optimization along with Deep Learning Enabled Computer Aided Diagnosis for Bone Cancer Classification (GSODL-CADBCC) on X-ray images. The aim of the GSODL-CADBCC approach is to accurately distinguish the input X-ray images into healthy and cancerous. This research presents the GSODL-CADBCC technique that leverages the bilateral filtering technique to remove the noise. This method uses the SqueezeNet model to generate feature vectors, and the GSO algorithm efficiently selects the hyperparameters. Finally, the extracted features can be classified by improved cuckoo search with a long short-term memory model. The experimental results demonstrate that the GSODL- CADBCC approach attains highest performance with an average accuracy of 95.52% on the training set data and 94.79% on the testing set data. This automated approach not only reduces the need for manual interpretation but also minimizes the risk of diagnostic errors and provides a viable option for precise medical imaging-based bone cancer screening.
Collapse
Affiliation(s)
- Sasanka Sekhar Dalai
- Department of Computer Science and Engineering, Siksha 'O' Anusandhan (deemed to Be University), Bhubaneswar, India
| | - Bharat Jyoti Ranjan Sahu
- Department of Computer Science and Engineering, Siksha 'O' Anusandhan (deemed to Be University), Bhubaneswar, India
| | - Jyotirmayee Rautaray
- Department of Computer Science and Engineering, Siksha 'O' Anusandhan (deemed to Be University), Bhubaneswar, India
| | - M Ijaz Khan
- Department of Mechanical Engineering, Lebanese American University, Beirut, Lebanon
| | - Bander A Jabr
- Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia
| | - Yasser A Ali
- Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia
| |
Collapse
|
4
|
Yu A, Lee L, Yi T, Fice M, Achar RK, Tepper S, Jones C, Klein E, Buac N, Lopez-Hisijos N, Colman MW, Gitelis S, Blank AT. Development and external validation of a machine learning model for prediction of survival in extremity leiomyosarcoma. Surg Oncol 2024; 57:102057. [PMID: 38462387 DOI: 10.1016/j.suronc.2024.102057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Revised: 01/25/2024] [Accepted: 02/28/2024] [Indexed: 03/12/2024]
Abstract
PURPOSE Machine learning (ML) models have been used to predict cancer survival in several sarcoma subtypes. However, none have investigated extremity leiomyosarcoma (LMS). ML is a powerful tool that has the potential to better prognosticate extremity LMS. METHODS The Surveillance, Epidemiology, and End Results (SEER) database was queried for cases of histologic extremity LMS (n = 634). Patient, tumor, and treatment characteristics were recorded, and ML models were developed to predict 1-, 3-, and 5-year survival. The best performing ML model was externally validated using an institutional cohort of extremity LMS patients (n = 46). RESULTS All ML models performed best at the 1-year time point and worst at the 5-year time point. On internal validation within the SEER cohort, the best models had c-statistics of 0.75-0.76 at the 5-year time point. The Random Forest (RF) model was the best performing model and used for external validation. This model also performed best at 1-year and worst at 5-year on external validation with c-statistics of 0.90 and 0.87, respectively. The RF model was well calibrated on external validation. This model has been made publicly available at https://rachar.shinyapps.io/lms_app/ CONCLUSIONS: ML models had excellent performance for survival prediction of extremity LMS. Future studies incorporating a larger institutional cohort may be needed to further validate the ML model for LMS prognostication.
Collapse
Affiliation(s)
- Austin Yu
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| | - Linus Lee
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| | - Thomas Yi
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| | - Michael Fice
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| | - Rohan K Achar
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| | - Sarah Tepper
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| | - Conor Jones
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| | - Evan Klein
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| | - Neil Buac
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| | | | - Matthew W Colman
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| | - Steven Gitelis
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| | - Alan T Blank
- Department of Orthopedic Surgery, Section of Orthopedic Oncology, Rush University Medical Center, Chicago, IL, USA.
| |
Collapse
|
5
|
Davey MS, Davey MG, Kenny P, Gheiti AJC. The use of radiomic analysis of magnetic resonance imaging findings in predicting features of early osteoarthritis of the knee-a systematic review and meta-analysis. Ir J Med Sci 2024; 193:2525-2530. [PMID: 38822185 PMCID: PMC11450002 DOI: 10.1007/s11845-024-03714-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2023] [Accepted: 05/14/2024] [Indexed: 06/02/2024]
Abstract
The primary aim of this study was to systematically review current literature evaluating the use of radiomics in establishing the role of magnetic resonance imaging (MRI) findings in native knees in predicting features of osteoarthritis (OA). A systematic review was performed with respect to PRISMA guidelines in search of studies reporting radiomic analysis of magnetic resonance imaging (MRI) to analyse patients with native knee OA. Sensitivity and specificity of radiomic analyses were included for meta-analysis. Following our initial literature search of 1271 studies, only 5 studies met our inclusion criteria. This included 1730 patients (71.5% females) with a mean age of 55.4 ± 15.6 years (range 24-66). The mean RQS of included studies was 16.6 (11-21). Meta-analysis demonstrated the pooled sensitivity and specificity for MRI in predicting features of OA in patients with native knees were 0.74 (95% CI 0.71, 0.78) and 0.85 (95% CI 0.83, 0.87), respectively. The results of this systematic review suggest that the high sensitivities and specificity of MRI-based radiomics may represent potential biomarker in the early identification and classification of native knee OA. Such analysis may inform surgeons to facilitate earlier non-operative management of knee OA in the select pre-symptomatic patients, prior to clinical or radiological evidence of degenerative change.
Collapse
Affiliation(s)
- Martin S Davey
- Connolly Hospital Blanchardstown, Dublin, Ireland.
- National Orthopaedic Hospital Cappagh, Dublin, Ireland.
- Royal College of Surgeons in Ireland, Dublin, Ireland.
| | | | - Paddy Kenny
- Connolly Hospital Blanchardstown, Dublin, Ireland
- National Orthopaedic Hospital Cappagh, Dublin, Ireland
- Royal College of Surgeons in Ireland, Dublin, Ireland
| | - Adrian J Cassar Gheiti
- Connolly Hospital Blanchardstown, Dublin, Ireland
- National Orthopaedic Hospital Cappagh, Dublin, Ireland
- Royal College of Surgeons in Ireland, Dublin, Ireland
| |
Collapse
|
6
|
Yildirim M, Yildirim H. CT radiomics-based machine learning model for differentiating between enchondroma and low-grade chondrosarcoma. Medicine (Baltimore) 2024; 103:e39311. [PMID: 39151512 PMCID: PMC11332721 DOI: 10.1097/md.0000000000039311] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Revised: 07/22/2024] [Accepted: 07/25/2024] [Indexed: 08/19/2024] Open
Abstract
It may be difficult to distinguish between enchondroma and low-grade malignant cartilage tumors (grade 1) radiologically. This study aimed to construct machine learning models using 3D computed tomography (CT)-based radiomics analysis to differentiate low-grade chondrosarcoma from enchondroma. A total of 30 patients with enchondroma and 26 with chondrosarcoma were included in this retrospective study. Tumor volume segmentation was manually performed by 2 musculoskeletal radiologists. In total, 107 radiomic features were obtained for each patient. The intraclass correlation coefficient was used to assess interobserver reliability and estimate the absolute agreement between the 2 radiologists. Algorithm-based information gain was used as a feature reduction method, and the 5 most important features were detected. For classification, 7 machine learning models were utilized. Classification was carried out using either all features or 5 features. There was good to excellent agreement between the 2 radiologists for the 107 features of each patient. Therefore, a dataset containing 107 features was used for machine learning classification. When assessed based on area under curve (AUC) values, classification using all features revealed that naive Bayes was the best model (AUC = 0.950), while classification using 5 features revealed that random forest was the best model for differentiating chondrosarcoma from enchondroma (AUC = 0.967). In conclusion, machine learning models using CT-based radiomics analysis can be used to differentiate between low-grade chondrosarcoma and enchondroma.
Collapse
Affiliation(s)
- Mustafa Yildirim
- Firat University School of Medicine Department of Radiology, Elaziğ, Turkey
| | - Hanefi Yildirim
- Firat University School of Medicine Department of Radiology, Elaziğ, Turkey
| |
Collapse
|
7
|
Yang X, Yang S, Bao Y, Wang Q, Peng Z, Lu S. Novel machine-learning prediction tools for overall survival of patients with chondrosarcoma: Based on recursive partitioning analysis. Cancer Med 2024; 13:e70058. [PMID: 39123313 PMCID: PMC11315679 DOI: 10.1002/cam4.70058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2024] [Revised: 07/04/2024] [Accepted: 07/20/2024] [Indexed: 08/12/2024] Open
Abstract
BACKGROUND Chondrosarcoma (CHS), a bone malignancy, poses a significant challenge due to its heterogeneous nature and resistance to conventional treatments. There is a clear need for advanced prognostic instruments that can integrate multiple prognostic factors to deliver personalized survival predictions for individual patients. This study aimed to develop a novel prediction tool based on recursive partitioning analysis (RPA) to improve the estimation of overall survival for patients with CHS. METHODS Data from the Surveillance, Epidemiology, and End Results (SEER) database were analyzed, including demographic, clinical, and treatment details of patients diagnosed between 2000 and 2018. Using C5.0 algorithm, decision trees were created to predict survival probabilities at 12, 24, 60, and 120 months. The performance of the models was assessed through confusion scatter plot, accuracy rate, receiver operator characteristic (ROC) curve, and area under ROC curve (AUC). RESULTS The study identified tumor histology, surgery, age, visceral (brain/liver/lung) metastasis, chemotherapy, tumor grade, and sex as critical predictors. Decision trees revealed distinct patterns for survival prediction at each time point. The models showed high accuracy (82.40%-89.09% in training group, and 82.16%-88.74% in test group) and discriminatory power (AUC: 0.806-0.894 in training group, and 0.808-0.882 in test group) in both training and testing datasets. An interactive web-based shiny APP (URL: https://yangxg1209.shinyapps.io/chondrosarcoma_survival_prediction/) was developed, simplifying the survival prediction process for clinicians. CONCLUSIONS This study successfully employed RPA to develop a user-friendly tool for personalized survival predictions in CHS. The decision tree models demonstrated robust predictive capabilities, with the interactive application facilitating clinical decision-making. Future prospective studies are recommended to validate these findings and further refine the predictive model.
Collapse
Affiliation(s)
- Xiong‐Gang Yang
- Department of Orthopedics, The First People's Hospital of Yunnan ProvinceThe Affiliated Hospital of Kunming University of Science and TechnologyKunmingYunnanChina
- The Key Laboratory of Digital Orthopedics of Yunnan ProvinceKunmingYunnanChina
| | - Shan‐Shan Yang
- Department of ProsthodonticsAffiliated Stomatological Hospital of Zunyi Medical University, Zunyi Medical UniversityZunyiChina
| | - Yi Bao
- Department of Orthopedics, The First People's Hospital of Yunnan ProvinceThe Affiliated Hospital of Kunming University of Science and TechnologyKunmingYunnanChina
- The Key Laboratory of Digital Orthopedics of Yunnan ProvinceKunmingYunnanChina
| | - Qi‐Yang Wang
- Department of Orthopedics, The First People's Hospital of Yunnan ProvinceThe Affiliated Hospital of Kunming University of Science and TechnologyKunmingYunnanChina
- The Key Laboratory of Digital Orthopedics of Yunnan ProvinceKunmingYunnanChina
| | - Zhi Peng
- Department of Orthopedics, The First People's Hospital of Yunnan ProvinceThe Affiliated Hospital of Kunming University of Science and TechnologyKunmingYunnanChina
- The Key Laboratory of Digital Orthopedics of Yunnan ProvinceKunmingYunnanChina
| | - Sheng Lu
- Department of Orthopedics, The First People's Hospital of Yunnan ProvinceThe Affiliated Hospital of Kunming University of Science and TechnologyKunmingYunnanChina
- The Key Laboratory of Digital Orthopedics of Yunnan ProvinceKunmingYunnanChina
| |
Collapse
|
8
|
Van Den Berghe T, Delbare F, Candries E, Lejoly M, Algoet C, Chen M, Laloo F, Huysse WCJ, Creytens D, Verstraete KL. A retrospective external validation study of the Birmingham Atypical Cartilage Tumour Imaging Protocol (BACTIP) for the management of solitary central cartilage tumours of the proximal humerus and around the knee. Eur Radiol 2024; 34:4988-5006. [PMID: 38319428 DOI: 10.1007/s00330-024-10604-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 12/01/2023] [Accepted: 12/20/2023] [Indexed: 02/07/2024]
Abstract
OBJECTIVES This study aimed to externally validate the Birmingham Atypical Cartilage Tumour Imaging Protocol (BACTIP) recommendations for differentiation/follow-up of central cartilage tumours (CCTs) of the proximal humerus, distal femur, and proximal tibia and to propose BACTIP adaptations if the results provide new insights. METHODS MRIs of 123 patients (45 ± 11 years, 37 men) with an untreated CCT with MRI follow-up (n = 62) or histopathological confirmation (n = 61) were retrospectively/consecutively included and categorised following the BACTIP (2003-2020 / Ghent University Hospital/Belgium). Tumour length and endosteal scalloping differences between enchondroma, atypical cartilaginous tumour (ACT), and high-grade chondrosarcoma (CS II/III/dedifferentiated) were evaluated. ROC-curve analysis for differentiating benign from malignant CCTs and for evaluating the BACTIP was performed. RESULTS For lesion length and endosteal scalloping, ROC-AUCs were poor and fair-excellent, respectively, for differentiating different CCT groups (0.59-0.69 versus 0.73-0.91). The diagnostic performance of endosteal scalloping and the BACTIP was higher than that of lesion length. A 1° endosteal scalloping cut-off differentiated enchondroma from ACT + high-grade chondrosarcoma with a sensitivity of 90%, reducing the potential diagnostic delay. However, the specificity was 29%, inducing overmedicalisation (excessive follow-up). ROC-AUC of the BACTIP was poor for differentiating enchondroma from ACT (ROC-AUC = 0.69; 95%CI = 0.51-0.87; p = 0.041) and fair-good for differentiation between other CCT groups (ROC-AUC = 0.72-0.81). BACTIP recommendations were incorrect/unsafe in five ACTs and one CSII, potentially inducing diagnostic delay. Eleven enchondromas received unnecessary referrals/follow-up. CONCLUSION Although promising as a useful tool for management/follow-up of CCTs of the proximal humerus, distal femur, and proximal tibia, five ACTs and one chondrosarcoma grade II were discharged, potentially inducing diagnostic delay, which could be reduced by adapting BACTIP cut-off values. CLINICAL RELEVANCE STATEMENT Mostly, Birmingham Atypical Cartilage Tumour Imaging Protocol (BACTIP) assesses central cartilage tumours of the proximal humerus and the knee correctly. Both when using the BACTIP and when adapting cut-offs, caution should be taken for the trade-off between underdiagnosis/potential diagnostic delay in chondrosarcomas and overmedicalisation in enchondromas. KEY POINTS • This retrospective external validation confirms the Birmingham Atypical Cartilage Tumour Imaging Protocol as a useful tool for initial assessment and follow-up recommendation of central cartilage tumours in the proximal humerus and around the knee in the majority of cases. • Using only the Birmingham Atypical Cartilage Tumour Imaging Protocol, both atypical cartilaginous tumours and high-grade chondrosarcomas (grade II, grade III, and dedifferentiated chondrosarcomas) can be misdiagnosed, excluding them from specialist referral and further follow-up, thus creating a potential risk of delayed diagnosis and worse prognosis. • Adapted cut-offs to maximise detection of atypical cartilaginous tumours and high-grade chondrosarcomas, minimise underdiagnosis and reduce potential diagnostic delay in malignant tumours but increase unnecessary referral and follow-up of benign tumours.
Collapse
Affiliation(s)
- Thomas Van Den Berghe
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium.
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium.
| | - Felix Delbare
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - Esther Candries
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - Maryse Lejoly
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - Chloé Algoet
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - Min Chen
- Department of Radiology, Peking University Shenzhen Hospital, Shenzhen, 518036, China
| | - Frederiek Laloo
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - Wouter C J Huysse
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - David Creytens
- Department of Pathology, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
| | - Koenraad L Verstraete
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| |
Collapse
|
9
|
Hong R, Li Q, Ma J, Lu C, Zhong Z. Computed tomography-based radiomics machine learning models for differentiating enchondroma and atypical cartilaginous tumor in long bones. ROFO-FORTSCHR RONTG 2024. [PMID: 39074797 DOI: 10.1055/a-2344-5398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/31/2024]
Abstract
To explore the value of CT-based radiomics machine learning models for differentiating enchondroma from atypical cartilaginous tumor (ACT) in long bones and methods to improve model performance.59 enchondromas and 53 ACTs in long bones confirmed by pathology were collected retrospectively. The features were extracted from preoperative CT images of these patients, and least absolute shrinkage and selection operator (LASSO) regression was used for feature selection and dimensionality reduction. The selected features were used to construct classification models by thirteen machine learning algorithms. The data set was randomly divided into a training set and a test set at a proportion of 7:3 by ten-fold cross-validation to evaluate the performance of these models.A total of 1199 features were extracted, 9 features were selected, and 13 radiomics machine learning models were constructed. The area under the curve (AUC) of 11 models was more than 0.8, and that of 3 models was more than 0.9. The Extremely Randomized Trees model achieved the best performance (AUC = 0.9375 ± 0.0884), followed by the Adaptive Boosting model (AUC = 0.9188 ± 0.1010) and the Linear Discriminant Analysis model (AUC = 0.9062 ± 0.1459).CT-based radiomics machine learning models had great ability to distinguish enchondroma and ACT in long bones. By using filters to deeply mine high-order features in the original image and selecting appropriate machine learning algorithms, the performance of the model can be improved. · CT-based radiomics machine learning models can distinguish enchondroma and ACT in long bones.. · Using filters and selecting advanced machine learning algorithms can improve model performance.. · Clinical features have limited utility in distinguishing enchondroma and ACT in long bones.. · Hong R, Li Q, Ma J et al. Computed tomography-based radiomics machine learning models for differentiating enchondroma and atypical cartilaginous tumor in long bones. Fortschr Röntgenstr 2024; DOI 10.1055/a-2344-5398.
Collapse
Affiliation(s)
- Rui Hong
- Radiology, The Third Hospital of Hebei Medical University, Shijiazhuang, China
| | - Qian Li
- Radiology, The Third Hospital of Hebei Medical University, Shijiazhuang, China
| | - Jielin Ma
- Oncology, The Third Hospital of Hebei Medical University, Shijiazhuang, China
| | - Chunmiao Lu
- Radiology, The Third Hospital of Hebei Medical University, Shijiazhuang, China
| | - Zhiwei Zhong
- Radiology, The Third Hospital of Hebei Medical University, Shijiazhuang, China
| |
Collapse
|
10
|
Li X, Zhang J, Leng Y, Liu J, Li L, Wan T, Dong W, Fan B, Gong L. Preoperative prediction of histopathological grading in patients with chondrosarcoma using MRI-based radiomics with semantic features. BMC Med Imaging 2024; 24:171. [PMID: 38992609 PMCID: PMC11238384 DOI: 10.1186/s12880-024-01330-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Accepted: 06/10/2024] [Indexed: 07/13/2024] Open
Abstract
BACKGROUND Distinguishing high-grade from low-grade chondrosarcoma is extremely vital not only for guiding the development of personalized surgical treatment but also for predicting the prognosis of patients. We aimed to establish and validate a magnetic resonance imaging (MRI)-based nomogram for predicting preoperative grading in patients with chondrosarcoma. METHODS Approximately 114 patients (60 and 54 cases with high-grade and low-grade chondrosarcoma, respectively) were recruited for this retrospective study. All patients were treated via surgery and histopathologically proven, and they were randomly divided into training (n = 80) and validation (n = 34) sets at a ratio of 7:3. Next, radiomics features were extracted from two sequences using the least absolute shrinkage and selection operator (LASSO) algorithms. The rad-scores were calculated and then subjected to logistic regression to develop a radiomics model. A nomogram combining independent predictive semantic features with radiomic by using multivariate logistic regression was established. The performance of each model was assessed by the receiver operating characteristic (ROC) curve analysis and the area under the curve, while clinical efficacy was evaluated via decision curve analysis (DCA). RESULTS Ultimately, six optimal radiomics signatures were extracted from T1-weighted imaging (T1WI) and T2-weighted imaging with fat suppression (T2WI-FS) sequences to develop the radiomics model. Tumour cartilage abundance, which emerged as an independent predictor, was significantly related to chondrosarcoma grading (p < 0.05). The AUC values of the radiomics model were 0.85 (95% CI, 0.76 to 0.95) in the training sets, and the corresponding AUC values in the validation sets were 0.82 (95% CI, 0.65 to 0.98), which were far superior to the clinical model AUC values of 0.68 (95% CI, 0.58 to 0.79) in the training sets and 0.72 (95% CI, 0.57 to 0.87) in the validation sets. The nomogram demonstrated good performance in the preoperative distinction of chondrosarcoma. The DCA analysis revealed that the nomogram model had a markedly higher clinical usefulness in predicting chondrosarcoma grading preoperatively than either the rad-score or clinical model alone. CONCLUSION The nomogram based on MRI radiomics combined with optimal independent factors had better performance for the preoperative differentiation between low-grade and high-grade chondrosarcoma and has potential as a noninvasive preoperative tool for personalizing clinical plans.
Collapse
Affiliation(s)
- Xiaofen Li
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Jingkun Zhang
- 2Department of Radiology, The Affiliated Hospital of Jiangxi University of Traditional Chinese Medicine, Nanchang, 330006, China
| | - Yinping Leng
- Department of Medical Imaging Center, The Second Affiliated Hospital of Nanchang University, No.1 Minde Road, Donghu District, Nanchang, 330006, China
| | - Jiaqi Liu
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Linlin Li
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Tianyi Wan
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Wentao Dong
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Bing Fan
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Lianggeng Gong
- Department of Medical Imaging Center, The Second Affiliated Hospital of Nanchang University, No.1 Minde Road, Donghu District, Nanchang, 330006, China.
| |
Collapse
|
11
|
Rizk PA, Gonzalez MR, Galoaa BM, Girgis AG, Van Der Linden L, Chang CY, Lozano-Calderon SA. Machine Learning-Assisted Decision Making in Orthopaedic Oncology. JBJS Rev 2024; 12:01874474-202407000-00005. [PMID: 38991098 DOI: 10.2106/jbjs.rvw.24.00057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/13/2024]
Abstract
» Artificial intelligence is an umbrella term for computational calculations that are designed to mimic human intelligence and problem-solving capabilities, although in the future, this may become an incomplete definition. Machine learning (ML) encompasses the development of algorithms or predictive models that generate outputs without explicit instructions, assisting in clinical predictions based on large data sets. Deep learning is a subset of ML that utilizes layers of networks that use various inter-relational connections to define and generalize data.» ML algorithms can enhance radiomics techniques for improved image evaluation and diagnosis. While ML shows promise with the advent of radiomics, there are still obstacles to overcome.» Several calculators leveraging ML algorithms have been developed to predict survival in primary sarcomas and metastatic bone disease utilizing patient-specific data. While these models often report exceptionally accurate performance, it is crucial to evaluate their robustness using standardized guidelines.» While increased computing power suggests continuous improvement of ML algorithms, these advancements must be balanced against challenges such as diversifying data, addressing ethical concerns, and enhancing model interpretability.
Collapse
Affiliation(s)
- Paul A Rizk
- Division of Orthopaedic Oncology, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Marcos R Gonzalez
- Division of Orthopaedic Oncology, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Bishoy M Galoaa
- Interdisciplinary Science & Engineering Complex (ISEC), Northeastern University, Boston, Massachusetts
| | - Andrew G Girgis
- Boston University Chobanian & Avedisian School of Medicine, Boston, Massachusetts
| | - Lotte Van Der Linden
- Division of Orthopaedic Oncology, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Connie Y Chang
- Musculoskeletal Imaging and Intervention, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts
| | - Santiago A Lozano-Calderon
- Division of Orthopaedic Oncology, Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
12
|
Gitto S, Cuocolo R, Giannetta V, Badalyan J, Di Luca F, Fusco S, Zantonelli G, Albano D, Messina C, Sconfienza LM. Effects of Interobserver Segmentation Variability and Intensity Discretization on MRI-Based Radiomic Feature Reproducibility of Lipoma and Atypical Lipomatous Tumor. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:1187-1200. [PMID: 38332405 PMCID: PMC11169199 DOI: 10.1007/s10278-024-00999-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Revised: 12/17/2023] [Accepted: 12/21/2023] [Indexed: 02/10/2024]
Abstract
Segmentation and image intensity discretization impact on radiomics workflow. The aim of this study is to investigate the influence of interobserver segmentation variability and intensity discretization methods on the reproducibility of MRI-based radiomic features in lipoma and atypical lipomatous tumor (ALT). Thirty patients with lipoma or ALT were retrospectively included. Three readers independently performed manual contour-focused segmentation on T1-weighted and T2-weighted sequences, including the whole tumor volume. Additionally, a marginal erosion was applied to segmentations to evaluate its influence on feature reproducibility. After image pre-processing, with included intensity discretization employing both fixed bin number and width approaches, 1106 radiomic features were extracted from each sequence. Intraclass correlation coefficient (ICC) 95% confidence interval lower bound ≥ 0.75 defined feature stability. In contour-focused vs. margin shrinkage segmentation, the rates of stable features extracted from T1-weighted and T2-weighted images ranged from 92.68 to 95.21% vs. 90.69 to 95.66% after fixed bin number discretization and from 95.75 to 97.65% vs. 95.39 to 96.47% after fixed bin width discretization, respectively, with no difference between the two segmentation approaches (p ≥ 0.175). Higher stable feature rates and higher feature ICC values were found when implementing discretization with fixed bin width compared to fixed bin number, regardless of the segmentation approach (p < 0.001). In conclusion, MRI radiomic features of lipoma and ALT are reproducible regardless of the segmentation approach and intensity discretization method, although a certain degree of interobserver variability highlights the need for a preliminary reliability analysis in future studies.
Collapse
Affiliation(s)
- Salvatore Gitto
- IRCCS Istituto Ortopedico Galeazzi, Via Cristina Belgioioso 173, 20157, Milan, Italy
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Milan, Italy
| | - Renato Cuocolo
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
| | - Vincenzo Giannetta
- Diagnostic and Interventional Radiology Department, IRCCS Ospedale San Raffaele-Turro, Università Vita-Salute San Raffaele, Milan, Italy
| | - Julietta Badalyan
- Scuola Di Specializzazione in Statistica Sanitaria E Biometria, Università Degli Studi Di Milano, Milan, Italy
| | - Filippo Di Luca
- Scuola Di Specializzazione in Radiodiagnostica, Università Degli Studi Di Milano, Milan, Italy
| | - Stefano Fusco
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Milan, Italy
| | - Giulia Zantonelli
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Milan, Italy
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Via Cristina Belgioioso 173, 20157, Milan, Italy
- Dipartimento Di Scienze Biomediche, Chirurgiche Ed Odontoiatriche, Università Degli Studi Di Milano, Milan, Italy
| | - Carmelo Messina
- IRCCS Istituto Ortopedico Galeazzi, Via Cristina Belgioioso 173, 20157, Milan, Italy
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Milan, Italy
| | - Luca Maria Sconfienza
- IRCCS Istituto Ortopedico Galeazzi, Via Cristina Belgioioso 173, 20157, Milan, Italy.
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Milan, Italy.
| |
Collapse
|
13
|
Li X, Shi X, Wang Y, Pang J, Zhao X, Xu Y, Li Q, Wang N, Duan F, Nie P. A CT-based radiomics nomogram for predicting histologic grade and outcome in chondrosarcoma. Cancer Imaging 2024; 24:50. [PMID: 38605380 PMCID: PMC11007871 DOI: 10.1186/s40644-024-00695-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 03/29/2024] [Indexed: 04/13/2024] Open
Abstract
OBJECTIVE The preoperative identification of tumor grade in chondrosarcoma (CS) is crucial for devising effective treatment strategies and predicting outcomes. The study aims to build and validate a CT-based radiomics nomogram (RN) for the preoperative identification of tumor grade in CS, and to evaluate the correlation between the RN-predicted tumor grade and postoperative outcome. METHODS A total of 196 patients (139 in the training cohort and 57 in the external validation cohort) were derived from three different centers. A clinical model, radiomics signature (RS) and RN (which combines significant clinical factors and RS) were developed and validated to assess their ability to distinguish low-grade from high-grade CS with area under the curve (AUC). Additionally, Kaplan-Meier survival analysis was applied to examine the association between RN-predicted tumor grade and recurrence-free survival (RFS) of CS. The predictive accuracy of the RN was evaluated using Harrell's concordance index (C-index), hazard ratio (HR) and AUC. RESULTS Size, endosteal scalloping and active periostitis were selected to build the clinical model. Three radiomics features, based on CT images, were selected to construct the RS. Both the RN (AUC, 0.842) and RS (AUC, 0.835) were superior to the clinical model (AUC, 0.776) in the validation set (P = 0.003, 0.040, respectively). A correlation between Nomogram score (Nomo-score, derived from RN) and RFS was observed through Kaplan-Meier survival analysis in the training and test cohorts (log-rank P < 0.050). Patients with high Nomo-score tumors were 2.669 times more likely to suffer recurrence than those with low Nomo-score tumors (HR, 2.669, P < 0.001). CONCLUSIONS The CT-based RN performed well in predicting both the histologic grade and outcome of CS.
Collapse
Affiliation(s)
- Xiaoli Li
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 369, Shanghai Road, 266000, Qingdao, Qingdao, Shandong, China
| | - Xianglong Shi
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 369, Shanghai Road, 266000, Qingdao, Qingdao, Shandong, China
| | - Yanmei Wang
- GE Healthcare China, Pudong New Town, Shanghai, China
| | - Jing Pang
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 369, Shanghai Road, 266000, Qingdao, Qingdao, Shandong, China
| | - Xia Zhao
- Department of Radiology, The Affiliated Hospital of Shandong University of Traditional Chinese Medicine, Jinan, Shandong, China
| | - Yuchao Xu
- School of Nuclear Science and Technology, University of South China, Hengyang, Hunan, China
| | - Qiyuan Li
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 369, Shanghai Road, 266000, Qingdao, Qingdao, Shandong, China
| | - Ning Wang
- Department of Radiology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, No. 324, Jingwu Road, 250021, Jinan, Shandong, China.
| | - Feng Duan
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 369, Shanghai Road, 266000, Qingdao, Qingdao, Shandong, China.
| | - Pei Nie
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 369, Shanghai Road, 266000, Qingdao, Qingdao, Shandong, China.
| |
Collapse
|
14
|
Salehi MA, Mohammadi S, Harandi H, Zakavi SS, Jahanshahi A, Shahrabi Farahani M, Wu JS. Diagnostic Performance of Artificial Intelligence in Detection of Primary Malignant Bone Tumors: a Meta-Analysis. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:766-777. [PMID: 38343243 PMCID: PMC11031503 DOI: 10.1007/s10278-023-00945-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 10/04/2023] [Accepted: 10/12/2023] [Indexed: 04/20/2024]
Abstract
We aim to conduct a meta-analysis on studies that evaluated the diagnostic performance of artificial intelligence (AI) algorithms in the detection of primary bone tumors, distinguishing them from other bone lesions, and comparing them with clinician assessment. A systematic search was conducted using a combination of keywords related to bone tumors and AI. After extracting contingency tables from all included studies, we performed a meta-analysis using random-effects model to determine the pooled sensitivity and specificity, accompanied by their respective 95% confidence intervals (CI). Quality assessment was evaluated using a modified version of Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) and Prediction Model Study Risk of Bias Assessment Tool (PROBAST). The pooled sensitivities for AI algorithms and clinicians on internal validation test sets for detecting bone neoplasms were 84% (95% CI: 79.88) and 76% (95% CI: 64.85), and pooled specificities were 86% (95% CI: 81.90) and 64% (95% CI: 55.72), respectively. At external validation, the pooled sensitivity and specificity for AI algorithms were 84% (95% CI: 75.90) and 91% (95% CI: 83.96), respectively. The same numbers for clinicians were 85% (95% CI: 73.92) and 94% (95% CI: 89.97), respectively. The sensitivity and specificity for clinicians with AI assistance were 95% (95% CI: 86.98) and 57% (95% CI: 48.66). Caution is needed when interpreting findings due to potential limitations. Further research is needed to bridge this gap in scientific understanding and promote effective implementation for medical practice advancement.
Collapse
Affiliation(s)
- Mohammad Amin Salehi
- School of Medicine, Tehran University of Medical Sciences, Pour Sina St, Keshavarz Blvd, Tehran, 1417613151, Iran
| | - Soheil Mohammadi
- School of Medicine, Tehran University of Medical Sciences, Pour Sina St, Keshavarz Blvd, Tehran, 1417613151, Iran.
| | - Hamid Harandi
- School of Medicine, Tehran University of Medical Sciences, Pour Sina St, Keshavarz Blvd, Tehran, 1417613151, Iran
| | - Seyed Sina Zakavi
- School of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Ali Jahanshahi
- School of Medicine, Guilan University of Medical Sciences, Rasht, Iran
| | | | - Jim S Wu
- Department of Radiology, Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Avenue, Boston, MA, 02215, USA
| |
Collapse
|
15
|
Gitto S, Annovazzi A, Nulle K, Interlenghi M, Salvatore C, Anelli V, Baldi J, Messina C, Albano D, Di Luca F, Armiraglio E, Parafioriti A, Luzzati A, Biagini R, Castiglioni I, Sconfienza LM. X-rays radiomics-based machine learning classification of atypical cartilaginous tumour and high-grade chondrosarcoma of long bones. EBioMedicine 2024; 101:105018. [PMID: 38377797 PMCID: PMC10884340 DOI: 10.1016/j.ebiom.2024.105018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Revised: 02/03/2024] [Accepted: 02/04/2024] [Indexed: 02/22/2024] Open
Abstract
BACKGROUND Atypical cartilaginous tumour (ACT) and high-grade chondrosarcoma (CS) of long bones are respectively managed with active surveillance or curettage and wide resection. Our aim was to determine diagnostic performance of X-rays radiomics-based machine learning for classification of ACT and high-grade CS of long bones. METHODS This retrospective, IRB-approved study included 150 patients with surgically treated and histology-proven lesions at two tertiary bone sarcoma centres. At centre 1, the dataset was split into training (n = 71 ACT, n = 24 high-grade CS) and internal test (n = 19 ACT, n = 6 high-grade CS) cohorts, respectively, based on the date of surgery. At centre 2, the dataset constituted the external test cohort (n = 12 ACT, n = 18 high-grade CS). Manual segmentation was performed on frontal view X-rays, using MRI or CT for preliminary identification of lesion margins. After image pre-processing, radiomic features were extracted. Dimensionality reduction included stability, coefficient of variation, and mutual information analyses. In the training cohort, after class balancing, a machine learning classifier (Support Vector Machine) was automatically tuned using nested 10-fold cross-validation. Then, it was tested on both the test cohorts and compared to two musculoskeletal radiologists' performance using McNemar's test. FINDINGS Five radiomic features (3 morphology, 2 texture) passed dimensionality reduction. After tuning on the training cohort (AUC = 0.75), the classifier had 80%, 83%, 79% and 80%, 89%, 67% accuracy, sensitivity, and specificity in the internal (temporally independent) and external (geographically independent) test cohorts, respectively, with no difference compared to the radiologists (p ≥ 0.617). INTERPRETATION X-rays radiomics-based machine learning accurately differentiates between ACT and high-grade CS of long bones. FUNDING AIRC Investigator Grant.
Collapse
Affiliation(s)
- Salvatore Gitto
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy; Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | - Alessio Annovazzi
- Nuclear Medicine Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Kitija Nulle
- Radiology Department, Riga East Clinical University Hospital, Riga, Latvia
| | | | - Christian Salvatore
- DeepTrace Technologies s.r.l., Milan, Italy; Department of Science, Technology and Society, University School for Advanced Studies IUSS Pavia, Pavia, Italy
| | - Vincenzo Anelli
- Radiology and Diagnostic Imaging Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Jacopo Baldi
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Carmelo Messina
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy; Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy; Dipartimento di Scienze Biomediche, Chirurgiche ed Odontoiatriche, Università degli Studi di Milano, Milan, Italy
| | - Filippo Di Luca
- Scuola di Specializzazione in Radiodiagnostica, Università degli Studi di Milano, Milan, Italy
| | | | | | | | - Roberto Biagini
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Isabella Castiglioni
- Department of Physics "G. Occhialini", Università degli Studi di Milano-Bicocca, Milan, Italy
| | - Luca Maria Sconfienza
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy; Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy.
| |
Collapse
|
16
|
Gitto S, Cuocolo R, Huisman M, Messina C, Albano D, Omoumi P, Kotter E, Maas M, Van Ooijen P, Sconfienza LM. CT and MRI radiomics of bone and soft-tissue sarcomas: an updated systematic review of reproducibility and validation strategies. Insights Imaging 2024; 15:54. [PMID: 38411750 PMCID: PMC10899555 DOI: 10.1186/s13244-024-01614-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Accepted: 01/09/2024] [Indexed: 02/28/2024] Open
Abstract
OBJECTIVE To systematically review radiomic feature reproducibility and model validation strategies in recent studies dealing with CT and MRI radiomics of bone and soft-tissue sarcomas, thus updating a previous version of this review which included studies published up to 2020. METHODS A literature search was conducted on EMBASE and PubMed databases for papers published between January 2021 and March 2023. Data regarding radiomic feature reproducibility and model validation strategies were extracted and analyzed. RESULTS Out of 201 identified papers, 55 were included. They dealt with radiomics of bone (n = 23) or soft-tissue (n = 32) tumors. Thirty-two (out of 54 employing manual or semiautomatic segmentation, 59%) studies included a feature reproducibility analysis. Reproducibility was assessed based on intra/interobserver segmentation variability in 30 (55%) and geometrical transformations of the region of interest in 2 (4%) studies. At least one machine learning validation technique was used for model development in 34 (62%) papers, and K-fold cross-validation was employed most frequently. A clinical validation of the model was reported in 38 (69%) papers. It was performed using a separate dataset from the primary institution (internal test) in 22 (40%), an independent dataset from another institution (external test) in 14 (25%) and both in 2 (4%) studies. CONCLUSIONS Compared to papers published up to 2020, a clear improvement was noted with almost double publications reporting methodological aspects related to reproducibility and validation. Larger multicenter investigations including external clinical validation and the publication of databases in open-access repositories could further improve methodology and bring radiomics from a research area to the clinical stage. CRITICAL RELEVANCE STATEMENT An improvement in feature reproducibility and model validation strategies has been shown in this updated systematic review on radiomics of bone and soft-tissue sarcomas, highlighting efforts to enhance methodology and bring radiomics from a research area to the clinical stage. KEY POINTS • 2021-2023 radiomic studies on CT and MRI of musculoskeletal sarcomas were reviewed. • Feature reproducibility was assessed in more than half (59%) of the studies. • Model clinical validation was performed in 69% of the studies. • Internal (44%) and/or external (29%) test datasets were employed for clinical validation.
Collapse
Affiliation(s)
- Salvatore Gitto
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Renato Cuocolo
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
| | - Merel Huisman
- Radboud University Medical Center, Department of Radiology and Nuclear Medicine, Nijmegen, The Netherlands
| | - Carmelo Messina
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Dipartimento di Scienze Biomediche, Chirurgiche ed Odontoiatriche, Università degli Studi di Milano, Milan, Italy
| | - Patrick Omoumi
- Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Elmar Kotter
- Department of Radiology, Freiburg University Medical Center, Freiburg, Germany
| | - Mario Maas
- Department of Radiology and Nuclear Medicine, Amsterdam UMC Location University of Amsterdam, Amsterdam, The Netherlands
| | - Peter Van Ooijen
- Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Luca Maria Sconfienza
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy.
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.
| |
Collapse
|
17
|
Gitto S, Serpi F, Albano D, Risoleo G, Fusco S, Messina C, Sconfienza LM. AI applications in musculoskeletal imaging: a narrative review. Eur Radiol Exp 2024; 8:22. [PMID: 38355767 PMCID: PMC10866817 DOI: 10.1186/s41747-024-00422-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 12/29/2023] [Indexed: 02/16/2024] Open
Abstract
This narrative review focuses on clinical applications of artificial intelligence (AI) in musculoskeletal imaging. A range of musculoskeletal disorders are discussed using a clinical-based approach, including trauma, bone age estimation, osteoarthritis, bone and soft-tissue tumors, and orthopedic implant-related pathology. Several AI algorithms have been applied to fracture detection and classification, which are potentially helpful tools for radiologists and clinicians. In bone age assessment, AI methods have been applied to assist radiologists by automatizing workflow, thus reducing workload and inter-observer variability. AI may potentially aid radiologists in identifying and grading abnormal findings of osteoarthritis as well as predicting the onset or progression of this disease. Either alone or combined with radiomics, AI algorithms may potentially improve diagnosis and outcome prediction of bone and soft-tissue tumors. Finally, information regarding appropriate positioning of orthopedic implants and related complications may be obtained using AI algorithms. In conclusion, rather than replacing radiologists, the use of AI should instead help them to optimize workflow, augment diagnostic performance, and keep up with ever-increasing workload.Relevance statement This narrative review provides an overview of AI applications in musculoskeletal imaging. As the number of AI technologies continues to increase, it will be crucial for radiologists to play a role in their selection and application as well as to fully understand their potential value in clinical practice. Key points • AI may potentially assist musculoskeletal radiologists in several interpretative tasks.• AI applications to trauma, age estimation, osteoarthritis, tumors, and orthopedic implants are discussed.• AI should help radiologists to optimize workflow and augment diagnostic performance.
Collapse
Affiliation(s)
- Salvatore Gitto
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Francesca Serpi
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Dipartimento di Scienze Biomediche, Chirurgiche ed Odontoiatriche, Università degli Studi di Milano, Milan, Italy
| | - Giovanni Risoleo
- Scuola di Specializzazione in Radiodiagnostica, Università degli Studi di Milano, Milan, Italy
| | - Stefano Fusco
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
| | - Carmelo Messina
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Luca Maria Sconfienza
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy.
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.
| |
Collapse
|
18
|
Yan H, Huang G, Yang Z, Chen Y, Xiang Z. Machine Learning-Based Multiparametric Magnetic Resonance Imaging Radiomics Model for Preoperative Predicting the Deep Stromal Invasion in Patients with Early Cervical Cancer. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:230-246. [PMID: 38343218 PMCID: PMC11266323 DOI: 10.1007/s10278-023-00906-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 08/12/2023] [Accepted: 09/11/2023] [Indexed: 03/02/2024]
Abstract
Deep stromal invasion is an important pathological factor associated with the treatments and prognosis of cervical cancer patients. Accurate determination of deep stromal invasion before radical hysterectomy (RH) is of great value for early clinical treatment decision-making and improving the prognosis of these patients. Machine learning is gradually applied in the construction of clinical models to improve the accuracy of clinical diagnosis or prediction, but whether machine learning can improve the preoperative diagnosis accuracy of deep stromal invasion in patients with cervical cancer was still unclear. This cross-sectional study was to construct three preoperative diagnostic models for deep stromal invasion in patients with early cervical cancer based on clinical, radiomics, and clinical combined radiomics data using the machine learning method. We enrolled 229 patients with early cervical cancer receiving RH combined with pelvic lymph node dissection (PLND). The least absolute shrinkage and selection operator (LASSO) and the fivefold cross-validation were applied to screen out radiomics features. Univariate and multivariate logistic regression analyses were applied to identify clinical predictors. All subjects were divided into the training set (n = 160) and testing set (n = 69) at a ratio of 7:3. Three light gradient boosting machine (LightGBM) models were constructed in the training set and verified in the testing set. The radiomics features were statistically different between deep stromal invasion < 1/3 group and deep stromal invasion ≥ 1/3 group. In the training set, the area under the curve (AUC) of the prediction model based on radiomics features was 0.951 (95% confidence interval (CI) 0.922-0.980), the AUC of the prediction model based on clinical predictors was 0.769 (95% CI 0.703-0.835), and the AUC of the prediction model based on radiomics features and clinical predictors was 0.969 (95% CI 0.947-0.990). The AUC of the prediction model based on radiomics features and clinical predictors was 0.914 (95% CI 0.848-0.980) in the testing set. The prediction model for deep stromal invasion in patients with early cervical cancer based on clinical and radiomics data exhibited good predictive performance with an AUC of 0.969, which might help the clinicians early identify patients with high risk of deep stromal invasion and provide timely interventions.
Collapse
Affiliation(s)
- Haowen Yan
- The First Affiliated Hospital of Jinan University, 510632, Guangzhou, China
- Department of Oncology, Guangzhou Panyu Central Hospital, 511400, Guangzhou, China
| | - Gaoting Huang
- Department of Gynecology and Oncology, Affiliated Cancer Hospital and Institute of Guangzhou Medical University, 510095, Guangzhou, China
| | - Zhihe Yang
- Department of Radiology, Guangzhou Panyu Central Hospital, 511400, Guangzhou, China
| | - Yirong Chen
- Department of Radiology, Guangzhou Panyu Central Hospital, 511400, Guangzhou, China
| | - Zhiming Xiang
- Department of Radiology, Guangzhou Panyu Central Hospital, 511400, Guangzhou, China.
- Jinan University, 601# Huangpu Avenue West, Tianhe District, 510632, Guangzhou, China.
| |
Collapse
|
19
|
Brandenberger D, White LM. Radiomics in Musculoskeletal Tumors. Semin Musculoskelet Radiol 2024; 28:49-61. [PMID: 38330970 DOI: 10.1055/s-0043-1776428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/10/2024]
Abstract
Sarcomas are heterogeneous rare tumors predominantly affecting the musculoskeletal (MSK) system. Due to significant variations in their natural history and variable response to conventional treatments, the discovery of novel diagnostic and prognostic biomarkers to guide therapeutic decision-making is an active and ongoing field of research. As new cellular, molecular, and metabolic biomarkers continue to be discovered, quantitative radiologic imaging is becoming increasingly important in sarcoma management. Radiomics offers the potential for discovering novel imaging diagnostic and predictive biomarkers using standard-of-care medical imaging. In this review, we detail the core concepts of radiomics and the application of radiomics to date in MSK sarcoma research. Also described are specific challenges related to radiomic studies, as well as viewpoints on clinical adoption and future perspectives in the field.
Collapse
Affiliation(s)
- Daniel Brandenberger
- Department of Medical Imaging, Musculoskeletal Imaging, University of Toronto, Toronto, Ontario, Canada
- Institut für Radiologie und Nuklearmedizin, Kantonsspital Baselland, Liestal, Switzerland
- Toronto Joint Department of Medical Imaging, University Health Network, Sinai Health System, and Women's College Hospital, Mount Sinai Hospital, Toronto, Ontario, Canada
| | - Lawrence M White
- Department of Medical Imaging, Musculoskeletal Imaging, University of Toronto, Toronto, Ontario, Canada
- Toronto Joint Department of Medical Imaging, University Health Network, Sinai Health System, and Women's College Hospital, Mount Sinai Hospital, Toronto, Ontario, Canada
| |
Collapse
|
20
|
Xu N, Guo X, Ouyang Z, Ran F, Li Q, Duan X, Zhu Y, Niu X, Liao C, Yang J. Multiparametric MRI-based radiomics combined with pathomics features for prediction of the efficacy of neoadjuvant chemotherapy in breast cancer. Heliyon 2024; 10:e24371. [PMID: 38298695 PMCID: PMC10827766 DOI: 10.1016/j.heliyon.2024.e24371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 12/25/2023] [Accepted: 01/08/2024] [Indexed: 02/02/2024] Open
Abstract
Purpose The aim of this study is to investigate a new method that combines radiological and pathological breast cancer information to predict discrepancies in pathological responses for individualized treatment planning. We used baseline multiparametric magnetic resonance imaging and hematoxylin and eosin-stained biopsy slides to extract quantitative feature information and predict the pathological response to neoadjuvant chemotherapy in breast cancer patients. Methods We retrospectively collected data from breast cancer patients who received neoadjuvant chemotherapy in our hospital from August 2016 to January 2018; multiparametric magnetic resonance imaging (contrast-enhanced T1-weighted imaging and diffusion-weighted imaging) and whole slide image of hematoxylin and eosin-stained biopsy sections were collected. Quantitative imaging features were extracted from the multiparametric magnetic resonance imaging and the whole slide image were used to construct a radiopathomics signature model powered by machine learning methods. Models based on multiparametric magnetic resonance imaging or whole slide image alone were also constructed for comparison and referred to as the radiomics signature and pathomics signature models, respectively. Four modeling methods were used to establish prediction models. Model performances were evaluated using receiver operating characteristic curve analysis and the area under the curve, accuracy, sensitivity, specificity, positive predictive value, and negative predictive value. Results The radiopathomics signature model had favourable performance for the prediction of pathological complete response in the training set (the best value: area under the curve 0.83, accuracy 0.84, and sensitivity 0.87), and in the test set (the best value: area under the curve 0.91, accuracy 0.90, and sensitivity 0.88). In the test set, the radiopathomics signature model also significantly outperformed the radiomics signature (the best value: area under the curve 0.83, accuracy 0.64, and sensitivity 0.62), pathomics signature (the best value: area under the curve 0.60, accuracy 0.74, and sensitivity 0.62) (p > 0.05). Decision curve analysis and calibration curves confirmed the excellent performance of these prediction models in discrimination, calibration, and clinical usefulness. Conclusions The results of this study suggest that radiopathomics, the combination of both radiological information regarding the whole tumor and pathological information at the cellular level, could potentially predict discrepancies in pathological response and provide evidence for rational treatment plans.
Collapse
Affiliation(s)
- Nan Xu
- Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center. No. 519 Kunzhou Road, Xishan District, Kunming 650118, Yunnan, PR China
| | - Xiaobin Guo
- Department of Radiology, Fuwai Central China Cardiovascular Hospital, Fuwai Road, Zhengzhou, Henan, 461464, PR China
| | - Zhiqiang Ouyang
- Department of Radiology, Kunming Yan’an Hospital (Yan’an Hospital Affiliated to Kunming Medical University), Kunming, PR China
| | - Fengming Ran
- Department of Pathology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center. No. 519 Kunzhou Road, Xishan District, Kunming 650118, Yunnan, PR China
| | - Qinqing Li
- Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center. No. 519 Kunzhou Road, Xishan District, Kunming 650118, Yunnan, PR China
| | - Xirui Duan
- Department of Radiology, Kunming Yan’an Hospital (Yan’an Hospital Affiliated to Kunming Medical University), Kunming, PR China
| | - Yu Zhu
- Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center. No. 519 Kunzhou Road, Xishan District, Kunming 650118, Yunnan, PR China
| | - Xiaofeng Niu
- Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center. No. 519 Kunzhou Road, Xishan District, Kunming 650118, Yunnan, PR China
| | - Chengde Liao
- Department of Radiology, Kunming Yan’an Hospital (Yan’an Hospital Affiliated to Kunming Medical University), Kunming, PR China
| | - Jun Yang
- Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center. No. 519 Kunzhou Road, Xishan District, Kunming 650118, Yunnan, PR China
| |
Collapse
|
21
|
Li Q, Wang N, Wang Y, Li X, Su Q, Zhang J, Zhao X, Dai Z, Wang Y, Sun L, Xing X, Yang G, Gao C, Nie P. Intratumoral and peritumoral CT radiomics in predicting prognosis in patients with chondrosarcoma: a multicenter study. Insights Imaging 2024; 15:9. [PMID: 38228977 DOI: 10.1186/s13244-023-01582-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Accepted: 11/29/2023] [Indexed: 01/18/2024] Open
Abstract
OBJECTIVE To evaluate the efficacy of the CT-based intratumoral, peritumoral, and combined radiomics signatures in predicting progression-free survival (PFS) of patients with chondrosarcoma (CS). METHODS In this study, patients diagnosed with CS between January 2009 and January 2022 were retrospectively screened, and 214 patients with CS from two centers were respectively enrolled into the training cohorts (institution 1, n = 113) and test cohorts (institution 2, n = 101). The intratumoral and peritumoral radiomics features were extracted from CT images. The intratumoral, peritumoral, and combined radiomics signatures were constructed respectively, and their radiomics scores (Rad-score) were calculated. The performance of intratumoral, peritumoral, and combined radiomics signatures in PFS prediction in patients with CS was evaluated by C-index, time-dependent area under the receiver operating characteristics curve (time-AUC), and time-dependent C-index (time C-index). RESULTS Eleven, 7, and 16 features were used to construct the intratumoral, peritumoral, and combined radiomics signatures, respectively. The combined radiomics signature showed the best prediction ability in the training cohort (C-index, 0.835; 95%; confidence interval [CI], 0.764-0.905) and the test cohort (C-index, 0.800; 95% CI, 0.681-0.920). Time-AUC and time C-index showed that the combined signature outperformed the intratumoral and peritumoral radiomics signatures in the prediction of PFS. CONCLUSION The CT-based combined signature incorporating intratumoral and peritumoral radiomics features can predict PFS in patients with CS, which might assist clinicians in selecting individualized surveillance and treatment plans for CS patients. CRITICAL RELEVANCE STATEMENT Develop and validate CT-based intratumoral, peritumoral, and combined radiomics signatures to evaluate the efficacy in predicting prognosis of patients with CS. KEY POINTS • Reliable prognostic models for preoperative chondrosarcoma are lacking. • Combined radiomics signature incorporating intratumoral and peritumoral features can predict progression-free survival in patients with chondrosarcoma. • Combined radiomics signature may facilitate individualized stratification and management of patients with chondrosarcoma.
Collapse
Affiliation(s)
- Qiyuan Li
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 16, Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Ning Wang
- Department of Radiology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China
| | - Yanmei Wang
- GE Healthcare China, Pudong New Town, Shanghai, China
| | - Xiaoli Li
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 16, Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Qiushi Su
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 16, Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Jing Zhang
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 16, Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Xia Zhao
- Department of Radiology, The Affiliated Hospital of Shandong University of Traditional Chinese Medicine, Jinan, Shandong, China
| | - Zhengjun Dai
- Scientific Research Department, Huiying Medical Technology Co., Ltd, Beijing, China
| | - Yao Wang
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 16, Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Li Sun
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 16, Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Xuxiao Xing
- Department of Radiology, The First Hospital of Xingtai, No. 376, Shunde Road, Xingtai, Hebei, China
| | - Guangjie Yang
- Department of Nuclear Medicine, The Affiliated Hospital of Qingdao University, No. 59, Haier Road, Qingdao, 266061, Shandong, China.
| | - Chuanping Gao
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 16, Jiangsu Road, Qingdao, 266003, Shandong, China.
| | - Pei Nie
- Department of Radiology, The Affiliated Hospital of Qingdao University, No. 16, Jiangsu Road, Qingdao, 266003, Shandong, China.
| |
Collapse
|
22
|
Zhang X, Peng J, Ji G, Li T, Li B, Xiong H. Research status and progress of radiomics in bone and soft tissue tumors: A review. Medicine (Baltimore) 2023; 102:e36196. [PMID: 38013345 PMCID: PMC10681559 DOI: 10.1097/md.0000000000036198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Accepted: 10/27/2023] [Indexed: 11/29/2023] Open
Abstract
Bone and soft tissue tumors are diverse, accompanying by complex histological components and significantly divergent biological behaviors. It is a challenge to address the demand for qualitative imaging as traditional imaging is restricted to the detection of anatomical structures and aberrant signals. With the improvement of digitalization in hospitals and medical centers, the introduction of electronic medical records and easier access to large amounts of information coupled with the improved computational power, traditional medicine has evolved into the combination of human brain, minimal data, and artificial intelligence. Scholars are committed to mining deeper levels of imaging data, and radiomics is worthy of promotion. Radiomics extracts subvisual quantitative features, analyzes them based on medical images, and quantifies tumor heterogeneity by outlining the region of interest and modeling. Two observers separately examined PubMed, Web of Science and CNKI to find existing studies, case reports, and clinical guidelines about research status and progress of radiomics in bone and soft tissue tumors from January 2010 to February 2023. When evaluating the literature, factors such as patient age, medical history, and severity of the condition will be considered. This narrative review summarizes the application and progress of radiomics in bone and soft tissue tumors.
Collapse
Affiliation(s)
- Xiaohan Zhang
- Department of Radiology, The First Affiliated Hospital of Yangtze University, Jingzhou, China
| | - Jie Peng
- Department of Radiology, The First Affiliated Hospital of Yangtze University, Jingzhou, China
| | - Guanghai Ji
- Department of Radiology, The First Affiliated Hospital of Yangtze University, Jingzhou, China
| | - Tian Li
- Department of Radiology, The First Affiliated Hospital of Yangtze University, Jingzhou, China
| | - Bo Li
- Department of Radiology, The First Affiliated Hospital of Yangtze University, Jingzhou, China
| | - Hao Xiong
- Department of Radiology, The First Affiliated Hospital of Yangtze University, Jingzhou, China
| |
Collapse
|
23
|
Anttila TT, Aspinen S, Pierides G, Haapamäki V, Laitinen MK, Ryhänen J. Enchondroma Detection from Hand Radiographs with an Interactive Deep Learning Segmentation Tool-A Feasibility Study. J Clin Med 2023; 12:7129. [PMID: 38002741 PMCID: PMC10672653 DOI: 10.3390/jcm12227129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2023] [Revised: 11/01/2023] [Accepted: 11/13/2023] [Indexed: 11/26/2023] Open
Abstract
Enchondromas are common benign bone tumors, usually presenting in the hand. They can cause symptoms such as swelling and pain but often go un-noticed. If the tumor expands, it can diminish the bone cortices and predispose the bone to fracture. Diagnosis is based on clinical investigation and radiographic imaging. Despite their typical appearance on radiographs, they can primarily be misdiagnosed or go totally unrecognized in the acute trauma setting. Earlier applications of deep learning models to image classification and pattern recognition suggest that this technique may also be utilized in detecting enchondroma in hand radiographs. We trained a deep learning model with 414 enchondroma radiographs to detect enchondroma from hand radiographs. A separate test set of 131 radiographs (47% with an enchondroma) was used to assess the performance of the trained deep learning model. Enchondroma annotation by three clinical experts served as our ground truth in assessing the deep learning model's performance. Our deep learning model detected 56 enchondromas from the 62 enchondroma radiographs. The area under receiver operator curve was 0.95. The F1 score for area statistical overlapping was 69.5%. Our deep learning model may be a useful tool for radiograph screening and raising suspicion of enchondroma.
Collapse
Affiliation(s)
- Turkka Tapio Anttila
- Musculoskeletal and Plastic Surgery, Department of Hand Surgery, University of Helsinki and Helsinki University Hospital, 00029 Helsinki, Finland
| | - Samuli Aspinen
- Musculoskeletal and Plastic Surgery, Department of Hand Surgery, University of Helsinki and Helsinki University Hospital, 00029 Helsinki, Finland
| | - Georgios Pierides
- Musculoskeletal and Plastic Surgery, Department of Hand Surgery, University of Helsinki and Helsinki University Hospital, 00029 Helsinki, Finland
| | - Ville Haapamäki
- Department of Radiology, University of Helsinki and Helsinki University Hospital, 00029 Helsinki, Finland
| | - Minna Katariina Laitinen
- Musculoskeletal and Plastic Surgery, Department of Orthopedic Surgery, University of Helsinki and Helsinki University Hospital, 00029 Helsinki, Finland
| | - Jorma Ryhänen
- Musculoskeletal and Plastic Surgery, Department of Hand Surgery, University of Helsinki and Helsinki University Hospital, 00029 Helsinki, Finland
| |
Collapse
|
24
|
Meng Y, Yang Y, Hu M, Zhang Z, Zhou X. Artificial intelligence-based radiomics in bone tumors: Technical advances and clinical application. Semin Cancer Biol 2023; 95:75-87. [PMID: 37499847 DOI: 10.1016/j.semcancer.2023.07.003] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Revised: 07/21/2023] [Accepted: 07/22/2023] [Indexed: 07/29/2023]
Abstract
Radiomics is the extraction of predefined mathematic features from medical images for predicting variables of clinical interest. Recent research has demonstrated that radiomics can be processed by artificial intelligence algorithms to reveal complex patterns and trends for diagnosis, and prediction of prognosis and response to treatment modalities in various types of cancer. Artificial intelligence tools can utilize radiological images to solve next-generation issues in clinical decision making. Bone tumors can be classified as primary and secondary (metastatic) tumors. Osteosarcoma, Ewing sarcoma, and chondrosarcoma are the dominating primary tumors of bone. The development of bone tumor model systems and relevant research, and the assessment of novel treatment methods are ongoing to improve clinical outcomes, notably for patients with metastases. Artificial intelligence and radiomics have been utilized in almost full spectrum of clinical care of bone tumors. Radiomics models have achieved excellent performance in the diagnosis and grading of bone tumors. Furthermore, the models enable to predict overall survival, metastases, and recurrence. Radiomics features have exhibited promise in assisting therapeutic planning and evaluation, especially neoadjuvant chemotherapy. This review provides an overview of the evolution and opportunities for artificial intelligence in imaging, with a focus on hand-crafted features and deep learning-based radiomics approaches. We summarize the current application of artificial intelligence-based radiomics both in primary and metastatic bone tumors, and discuss the limitations and future opportunities of artificial intelligence-based radiomics in this field. In the era of personalized medicine, our in-depth understanding of emerging artificial intelligence-based radiomics approaches will bring innovative solutions to bone tumors and achieve clinical application.
Collapse
Affiliation(s)
- Yichen Meng
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Yue Yang
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Miao Hu
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Zheng Zhang
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China.
| | - Xuhui Zhou
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China.
| |
Collapse
|
25
|
Li Y, Dong B, Yuan P. The diagnostic value of machine learning for the classification of malignant bone tumor: a systematic evaluation and meta-analysis. Front Oncol 2023; 13:1207175. [PMID: 37746301 PMCID: PMC10513372 DOI: 10.3389/fonc.2023.1207175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Accepted: 08/23/2023] [Indexed: 09/26/2023] Open
Abstract
Background Malignant bone tumors are a type of cancer with varying malignancy and prognosis. Accurate diagnosis and classification are crucial for treatment and prognosis assessment. Machine learning has been introduced for early differential diagnosis of malignant bone tumors, but its performance is controversial. This systematic review and meta-analysis aims to explore the diagnostic value of machine learning for malignant bone tumors. Methods PubMed, Embase, Cochrane Library, and Web of Science were searched for literature on machine learning in the differential diagnosis of malignant bone tumors up to October 31, 2022. The risk of bias assessment was conducted using QUADAS-2. A bivariate mixed-effects model was used for meta-analysis, with subgroup analyses by machine learning methods and modeling approaches. Results The inclusion comprised 31 publications with 382,371 patients, including 141,315 with malignant bone tumors. Meta-analysis results showed machine learning sensitivity and specificity of 0.87 [95% CI: 0.81,0.91] and 0.91 [95% CI: 0.86,0.94] in the training set, and 0.83 [95% CI: 0.74,0.89] and 0.87 [95% CI: 0.79,0.92] in the validation set. Subgroup analysis revealed MRI-based radiomics was the most common approach, with sensitivity and specificity of 0.85 [95% CI: 0.74,0.91] and 0.87 [95% CI: 0.81,0.91] in the training set, and 0.79 [95% CI: 0.70,0.86] and 0.79 [95% CI: 0.70,0.86] in the validation set. Convolutional neural networks were the most common model type, with sensitivity and specificity of 0.86 [95% CI: 0.72,0.94] and 0.92 [95% CI: 0.82,0.97] in the training set, and 0.87 [95% CI: 0.51,0.98] and 0.87 [95% CI: 0.69,0.96] in the validation set. Conclusion Machine learning is mainly applied in radiomics for diagnosing malignant bone tumors, showing desirable diagnostic performance. Machine learning can be an early adjunctive diagnostic method but requires further research and validation to determine its practical efficiency and clinical application prospects. Systematic review registration https://www.crd.york.ac.uk/prospero/, identifier CRD42023387057.
Collapse
Affiliation(s)
| | - Bo Dong
- Department of Orthopedics, Xi’an Honghui Hospital, Xi’an Jiaotong University, Xi’an Shaanxi, China
| | | |
Collapse
|
26
|
Gundavda MK, Lazarides AL, Burke ZDC, Focaccia M, Griffin AM, Tsoi KM, Ferguson PC, Wunder JS. Is a radiological score able to predict resection-grade chondrosarcoma in primary intraosseous lesions of the long bones? Bone Joint J 2023; 105-B:808-814. [PMID: 37391201 DOI: 10.1302/0301-620x.105b7.bjj-2022-1369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/02/2023]
Abstract
Aims The preoperative grading of chondrosarcomas of bone that accurately predicts surgical management is difficult for surgeons, radiologists, and pathologists. There are often discrepancies in grade between the initial biopsy and the final histology. Recent advances in the use of imaging methods have shown promise in the ability to predict the final grade. The most important clinical distinction is between grade 1 chondrosarcomas, which are amenable to curettage, and resection-grade chondrosarcomas (grade 2 and 3) which require en bloc resection. The aim of this study was to evaluate the use of a Radiological Aggressiveness Score (RAS) to predict the grade of primary chondrosarcomas in long bones and thus to guide management. Methods A total of 113 patients with a primary chondrosarcoma of a long bone presenting between January 2001 and December 2021 were identified on retrospective review of a single oncology centre's prospectively collected database. The nine-parameter RAS included variables from radiographs and MRI scans. The best cut-off of parameters to predict the final grade of chondrosarcoma after resection was determined using a receiver operating characteristic curve (ROC), and this was correlated with the biopsy grade. Results A RAS of ≥ four parameters was 97.9% sensitive and 90.5% specific in predicting resection-grade chondrosarcoma based on a ROC cut-off derived using the Youden index. Cronbach's α of 0.897 was derived as the interclass correlation for scoring the lesions by four blinded reviewers who were surgeons. Concordance between resection-grade lesions predicted from the RAS and ROC cut-off with the final grade after resection was 96.46%. Concordance between the biopsy grade and the final grade was 63.8%. However, when the patients were analyzed based on surgical management, the initial biopsy was able to differentiate low-grade from resection-grade chondrosarcomas in 82.9% of biopsies. Conclusion These findings suggest that the RAS is an accurate method for guiding the surgical management of patients with these tumours, particularly when the initial biopsy results are discordant with the clinical presentation.
Collapse
Affiliation(s)
- Manit K Gundavda
- University Musculoskeletal Oncology Unit, Division of Orthopaedic Surgery, Department of Surgery, Mount Sinai Hospital, University of Toronto, Toronto, Canada
- Centre for Bone & Joint/Cancer - Bone and Soft Tissue Tumours, Kokilaben Dhirubhai Ambani Hospital, Mumbai, India
| | - Alexander L Lazarides
- University Musculoskeletal Oncology Unit, Division of Orthopaedic Surgery, Department of Surgery, Mount Sinai Hospital, University of Toronto, Toronto, Canada
- Department of Sarcoma, Mofitt Cancer Centre, Tampa, Florida, USA
| | - Zachary D C Burke
- University Musculoskeletal Oncology Unit, Division of Orthopaedic Surgery, Department of Surgery, Mount Sinai Hospital, University of Toronto, Toronto, Canada
- Sarcoma Program, Cleveland Clinic Foundation, Cleveland, Ohio, USA
| | - Marco Focaccia
- University Musculoskeletal Oncology Unit, Division of Orthopaedic Surgery, Department of Surgery, Mount Sinai Hospital, University of Toronto, Toronto, Canada
- Orthopaedic Oncology Unit, IRCCS Instituto Orthopedico Rizzoli, Bologna, Italy
| | - Anthony M Griffin
- University Musculoskeletal Oncology Unit, Division of Orthopaedic Surgery, Department of Surgery, Mount Sinai Hospital, University of Toronto, Toronto, Canada
| | - Kim M Tsoi
- University Musculoskeletal Oncology Unit, Division of Orthopaedic Surgery, Department of Surgery, Mount Sinai Hospital, University of Toronto, Toronto, Canada
| | - Peter C Ferguson
- University Musculoskeletal Oncology Unit, Division of Orthopaedic Surgery, Department of Surgery, Mount Sinai Hospital, University of Toronto, Toronto, Canada
| | - Jay S Wunder
- University Musculoskeletal Oncology Unit, Division of Orthopaedic Surgery, Department of Surgery, Mount Sinai Hospital, University of Toronto, Toronto, Canada
| |
Collapse
|
27
|
Gitto S, Interlenghi M, Cuocolo R, Salvatore C, Giannetta V, Badalyan J, Gallazzi E, Spinelli MS, Gallazzi M, Serpi F, Messina C, Albano D, Annovazzi A, Anelli V, Baldi J, Aliprandi A, Armiraglio E, Parafioriti A, Daolio PA, Luzzati A, Biagini R, Castiglioni I, Sconfienza LM. MRI radiomics-based machine learning for classification of deep-seated lipoma and atypical lipomatous tumor of the extremities. LA RADIOLOGIA MEDICA 2023:10.1007/s11547-023-01657-y. [PMID: 37335422 DOI: 10.1007/s11547-023-01657-y] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Accepted: 05/26/2023] [Indexed: 06/21/2023]
Abstract
PURPOSE To determine diagnostic performance of MRI radiomics-based machine learning for classification of deep-seated lipoma and atypical lipomatous tumor (ALT) of the extremities. MATERIAL AND METHODS This retrospective study was performed at three tertiary sarcoma centers and included 150 patients with surgically treated and histology-proven lesions. The training-validation cohort consisted of 114 patients from centers 1 and 2 (n = 64 lipoma, n = 50 ALT). The external test cohort consisted of 36 patients from center 3 (n = 24 lipoma, n = 12 ALT). 3D segmentation was manually performed on T1- and T2-weighted MRI. After extraction and selection of radiomic features, three machine learning classifiers were trained and validated using nested fivefold cross-validation. The best-performing classifier according to previous analysis was evaluated and compared to an experienced musculoskeletal radiologist in the external test cohort. RESULTS Eight features passed feature selection and were incorporated into the machine learning models. After training and validation (74% ROC-AUC), the best-performing classifier (Random Forest) showed 92% sensitivity and 33% specificity in the external test cohort with no statistical difference compared to the radiologist (p = 0.474). CONCLUSION MRI radiomics-based machine learning may classify deep-seated lipoma and ALT of the extremities with high sensitivity and negative predictive value, thus potentially serving as a non-invasive screening tool to reduce unnecessary referral to tertiary tumor centers.
Collapse
Affiliation(s)
- Salvatore Gitto
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | | | - Renato Cuocolo
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Department of Electrical Engineering and Information Technology, University of Naples "Federico II", Naples, Italy
| | - Christian Salvatore
- DeepTrace Technologies, Milan, Italy
- Department of Science, Technology and Society, University School for Advanced Studies IUSS Pavia, Pavia, Italy
| | - Vincenzo Giannetta
- Diagnostic and Interventional Radiology Department, IRCCS Ospedale San Raffaele-Turro, Università Vita-Salute San Raffaele, Milan, Italy
| | - Julietta Badalyan
- Scuola di Specializzazione in Statistica Sanitaria e Biometria, Università Degli Studi Di Milano, Milan, Italy
| | - Enrico Gallazzi
- UOC Patologia Vertebrale e Scoliosi, ASST Gaetano Pini - CTO, Milan, Italy
| | | | - Mauro Gallazzi
- UOC Radiodiagnostica, ASST Gaetano Pini - CTO, Milan, Italy
| | - Francesca Serpi
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | - Carmelo Messina
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | | | - Alessio Annovazzi
- Nuclear Medicine Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Vincenzo Anelli
- Radiology and Diagnostic Imaging Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Jacopo Baldi
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | | | | | | | | | | | - Roberto Biagini
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Isabella Castiglioni
- Department of Physics, Università degli Studi di Milano-Bicocca, Milan, Italy
- Institute of Biomedical Imaging and Physiology, Consiglio Nazionale Delle Ricerche, Segrate, Italy
| | - Luca Maria Sconfienza
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy.
| |
Collapse
|
28
|
Cilengir AH, Evrimler S, Serel TA, Uluc E, Tosun O. The diagnostic value of magnetic resonance imaging-based texture analysis in differentiating enchondroma and chondrosarcoma. Skeletal Radiol 2023; 52:1039-1049. [PMID: 36434265 DOI: 10.1007/s00256-022-04242-y] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/01/2022] [Revised: 11/12/2022] [Accepted: 11/21/2022] [Indexed: 11/26/2022]
Abstract
OBJECTIVE To assess the diagnostic performance of MRI-based texture analysis for differentiating enchondromas and chondrosarcomas, especially on fat-suppressed proton density (FS-PD) images. MATERIALS AND METHODS The whole tumor volumes of 23 chondrosarcomas and 24 enchondromas were manually segmented on both FS-PD and T1-weighted images. A total of 861 radiomic features were extracted. SelectKBest was used to select the features. The data were randomly split into training (n = 36) and test (n = 10) for T1-weighted and training (n = 37) and test (n = 10) for FS-PD datasets. Fivefold cross-validation was performed. Fifteen machine learning models were created using the training set. The best models for T1-weighted, FS-PD, and T1-weighted + FS-PD images were selected in terms of accuracy and area under the curve (AUC). RESULTS There were 7 men and 16 women in the chondrosarcoma group (mean ± standard deviation age, 45.65 ± 11.24) and 7 men and 17 women in the enchondroma group (mean ± standard deviation age, 46.17 ± 11.79). Naive Bayes was the best model for accuracy and AUC for T1-weighted images (AUC = 0.76, accuracy = 80%, recall = 80%, precision = 80%, F1 score = 80%). The best model for FS-PD images was the K neighbors classifier for accuracy and AUC (AUC = 1.00, accuracy = 80%, recall = 80%, precision = 100%, F1 score = 89%). The best model for T1-weighted + FS-PD images was logistic regression for accuracy and AUC (AUC = 0.84, accuracy = 80%, recall = 60%, precision = 100%, F1 score = 75%). CONCLUSION MRI-based machine learning models have promising results in the discrimination of enchondroma and chondrosarcoma based on radiomic features obtained from both FS-PD and T1-weighted images.
Collapse
Affiliation(s)
- Atilla Hikmet Cilengir
- Faculty of Medicine, Department of Radiology, Izmir Democracy University, 35140, Konak, Izmir, Turkey.
| | - Sehnaz Evrimler
- Faculty of Medicine, Department of Radiology, Suleyman Demirel University, 32260, Isparta, Turkey
| | - Tekin Ahmet Serel
- Faculty of Medicine, Department of Urology, Suleyman Demirel University, 32260, Isparta, Turkey
| | - Engin Uluc
- Department of Radiology, Izmir Katip Celebi University Ataturk Training and Research Hospital, 35360, Karabaglar, Izmir, Turkey
| | - Ozgur Tosun
- Department of Radiology, Izmir Katip Celebi University Ataturk Training and Research Hospital, 35360, Karabaglar, Izmir, Turkey
| |
Collapse
|
29
|
Iqbal S, N. Qureshi A, Li J, Mahmood T. On the Analyses of Medical Images Using Traditional Machine Learning Techniques and Convolutional Neural Networks. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING : STATE OF THE ART REVIEWS 2023; 30:3173-3233. [PMID: 37260910 PMCID: PMC10071480 DOI: 10.1007/s11831-023-09899-9] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Accepted: 02/19/2023] [Indexed: 06/02/2023]
Abstract
Convolutional neural network (CNN) has shown dissuasive accomplishment on different areas especially Object Detection, Segmentation, Reconstruction (2D and 3D), Information Retrieval, Medical Image Registration, Multi-lingual translation, Local language Processing, Anomaly Detection on video and Speech Recognition. CNN is a special type of Neural Network, which has compelling and effective learning ability to learn features at several steps during augmentation of the data. Recently, different interesting and inspiring ideas of Deep Learning (DL) such as different activation functions, hyperparameter optimization, regularization, momentum and loss functions has improved the performance, operation and execution of CNN Different internal architecture innovation of CNN and different representational style of CNN has significantly improved the performance. This survey focuses on internal taxonomy of deep learning, different models of vonvolutional neural network, especially depth and width of models and in addition CNN components, applications and current challenges of deep learning.
Collapse
Affiliation(s)
- Saeed Iqbal
- Department of Computer Science, Faculty of Information Technology & Computer Science, University of Central Punjab, Lahore, Punjab 54000 Pakistan
- Faculty of Information Technology, Beijing University of Technology, Beijing, 100124 Beijing China
| | - Adnan N. Qureshi
- Department of Computer Science, Faculty of Information Technology & Computer Science, University of Central Punjab, Lahore, Punjab 54000 Pakistan
| | - Jianqiang Li
- Faculty of Information Technology, Beijing University of Technology, Beijing, 100124 Beijing China
- Beijing Engineering Research Center for IoT Software and Systems, Beijing University of Technology, Beijing, 100124 Beijing China
| | - Tariq Mahmood
- Artificial Intelligence and Data Analytics (AIDA) Lab, College of Computer & Information Sciences (CCIS), Prince Sultan University, Riyadh, 11586 Kingdom of Saudi Arabia
| |
Collapse
|
30
|
Erdem F, Tamsel İ, Demirpolat G. The use of radiomics and machine learning for the differentiation of chondrosarcoma from enchondroma. JOURNAL OF CLINICAL ULTRASOUND : JCU 2023. [PMID: 37009697 DOI: 10.1002/jcu.23461] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 03/18/2023] [Accepted: 03/25/2023] [Indexed: 06/19/2023]
Abstract
PURPOSE To construct and compare machine learning models for differentiating chondrosarcoma from enchondroma using radiomic features from T1 and fat suppressed Proton density (PD) magnetic resonance imaging (MRI). METHODS Eighty-eight patients (57 with enchondroma, 31 with chondrosarcoma) were retrospectively included. Histogram matching and N4ITK MRI bias correction filters were applied. An experienced musculoskeletal radiologist and a senior resident in radiology performed manual segmentation. Voxel sizes were resampled. Laplacian of Gaussian filter and wavelet-based features were used. One thousand eight hundred eighty-eight features were obtained for each patient, with 944 from T1 and 944 from PD images. Sixty-four unstable features were removed. Seven machine learning models were used for classification. RESULTS Classification with all features showed neural network was the best model for both readers' datasets with area under the curve (AUC), classification accuracy (CA), and F1 score of 0.979, 0.984; 0.920, 0.932; and 0.889, 0.903, respectively. Four features, including one common to both readers, were selected using fast correlation based filter. The best performing models with selected features were gradient boosting for Fatih Erdem's dataset and neural network for Gülen Demirpolat's dataset with AUC, CA, and F1 score of 0.990, 0.979; 0.943, 0.955; 0.921, 0.933, respectively. Neural Network was the second-best model for FE's dataset based on AUC (0.984). CONCLUSION Using pathology as a gold standard, this study defined and compared seven well-performing models to distinguish enchondromas from chondrosarcomas and provided radiomic feature stability and reproducibility among the readers.
Collapse
Affiliation(s)
- Fatih Erdem
- Department of Radiology, Balikesir University Hospital, Paşaköy, Bigadiç yolu üzeri, 10145 Balıkesir Merkez, Altıeylül, Balıkesir, Turkey
| | - İpek Tamsel
- Department of Radiology, Ege University Hospital, 35100, Bornova, Izmir, Turkey
| | - Gülen Demirpolat
- Department of Radiology, Balikesir University Hospital, Paşaköy, Bigadiç yolu üzeri, 10145 Balıkesir Merkez, Altıeylül, Balıkesir, Turkey
| |
Collapse
|
31
|
Pu C, Hu X, Lv S, Wu Y, Yu F, Zhu W, Zhang L, Fei J, He C, Ling X, Wang F, Hu H. Identification of fibrosis in hypertrophic cardiomyopathy: a radiomic study on cardiac magnetic resonance cine imaging. Eur Radiol 2023; 33:2301-2311. [PMID: 36334102 PMCID: PMC10017609 DOI: 10.1007/s00330-022-09217-0] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Revised: 09/29/2022] [Accepted: 10/03/2022] [Indexed: 11/08/2022]
Abstract
OBJECTIVES Hypertrophic cardiomyopathy (HCM) often requires repeated enhanced cardiac magnetic resonance (CMR) imaging to detect fibrosis. We aimed to develop a practical model based on cine imaging to help identify patients with high risk of fibrosis and screen out patients without fibrosis to avoid unnecessary injection of contrast. METHODS A total of 273 patients with HCM were divided into training and test sets at a ratio of 7:3. Logistic regression analysis was used to find predictive image features to construct CMR model. Radiomic features were derived from the maximal wall thickness (MWT) slice and entire left ventricular (LV) myocardium. Extreme gradient boosting was used to build radiomic models. Integrated models were established by fusing image features and radiomic models. The model performance was validated in the test set and assessed by ROC and calibration curve and decision curve analysis (DCA). RESULTS We established five prediction models, including CMR, R1 (based on the MWT slice), R2 (based on the entire LV myocardium), and two integrated models (ICMR+R1 and ICMR+R2). In the test set, ICMR+R2 model had an excellent AUC value (0.898), diagnostic accuracy (89.02%), sensitivity (92.54%), and F1 score (93.23%) in identifying patients with positive late gadolinium enhancement. The calibration plots and DCA indicated that ICMR+R2 model was well-calibrated and presented a better net benefit than other models. CONCLUSIONS A predictive model that fused image and radiomic features from the entire LV myocardium had good diagnostic performance, robustness, and clinical utility. KEY POINTS • Hypertrophic cardiomyopathy is prone to fibrosis, requiring patients to undergo repeated enhanced cardiac magnetic resonance imaging to detect fibrosis over their lifetime follow-up. • A predictive model based on the entire left ventricular myocardium outperformed a model based on a slice of the maximal wall thickness. • A predictive model that fused image and radiomic features from the entire left ventricular myocardium had excellent diagnostic performance, robustness, and clinical utility.
Collapse
Affiliation(s)
- Cailing Pu
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3 Qingchun East Road, Hangzhou, 310016, Zhejiang Province, China
| | - Xi Hu
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3 Qingchun East Road, Hangzhou, 310016, Zhejiang Province, China
| | - Sangying Lv
- Department of Radiology, Shaoxing People's Hospital, Shaoxing, Zhejiang Province, China
| | - Yan Wu
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3 Qingchun East Road, Hangzhou, 310016, Zhejiang Province, China
| | - Feidan Yu
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3 Qingchun East Road, Hangzhou, 310016, Zhejiang Province, China
| | - Wenchao Zhu
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3 Qingchun East Road, Hangzhou, 310016, Zhejiang Province, China
| | - Lingjie Zhang
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3 Qingchun East Road, Hangzhou, 310016, Zhejiang Province, China
| | - Jingle Fei
- Department of Radiology, Lishui Municipal Central Hospital, Lishui, Zhejiang Province, China
| | - Chengbin He
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3 Qingchun East Road, Hangzhou, 310016, Zhejiang Province, China
| | - Xiaoli Ling
- Department of Radiology, The Affiliated Hospital of Hangzhou Normal University, Hangzhou, Zhejiang Province, China
| | - Fuyan Wang
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3 Qingchun East Road, Hangzhou, 310016, Zhejiang Province, China
| | - Hongjie Hu
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3 Qingchun East Road, Hangzhou, 310016, Zhejiang Province, China.
| |
Collapse
|
32
|
Ong W, Zhu L, Tan YL, Teo EC, Tan JH, Kumar N, Vellayappan BA, Ooi BC, Quek ST, Makmur A, Hallinan JTPD. Application of Machine Learning for Differentiating Bone Malignancy on Imaging: A Systematic Review. Cancers (Basel) 2023; 15:cancers15061837. [PMID: 36980722 PMCID: PMC10047175 DOI: 10.3390/cancers15061837] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 03/07/2023] [Accepted: 03/16/2023] [Indexed: 03/22/2023] Open
Abstract
An accurate diagnosis of bone tumours on imaging is crucial for appropriate and successful treatment. The advent of Artificial intelligence (AI) and machine learning methods to characterize and assess bone tumours on various imaging modalities may assist in the diagnostic workflow. The purpose of this review article is to summarise the most recent evidence for AI techniques using imaging for differentiating benign from malignant lesions, the characterization of various malignant bone lesions, and their potential clinical application. A systematic search through electronic databases (PubMed, MEDLINE, Web of Science, and clinicaltrials.gov) was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A total of 34 articles were retrieved from the databases and the key findings were compiled and summarised. A total of 34 articles reported the use of AI techniques to distinguish between benign vs. malignant bone lesions, of which 12 (35.3%) focused on radiographs, 12 (35.3%) on MRI, 5 (14.7%) on CT and 5 (14.7%) on PET/CT. The overall reported accuracy, sensitivity, and specificity of AI in distinguishing between benign vs. malignant bone lesions ranges from 0.44–0.99, 0.63–1.00, and 0.73–0.96, respectively, with AUCs of 0.73–0.96. In conclusion, the use of AI to discriminate bone lesions on imaging has achieved a relatively good performance in various imaging modalities, with high sensitivity, specificity, and accuracy for distinguishing between benign vs. malignant lesions in several cohort studies. However, further research is necessary to test the clinical performance of these algorithms before they can be facilitated and integrated into routine clinical practice.
Collapse
Affiliation(s)
- Wilson Ong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Correspondence: ; Tel.: +65-67725207
| | - Lei Zhu
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore
| | - Yi Liang Tan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Ee Chin Teo
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Jiong Hao Tan
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - Naresh Kumar
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - Balamurugan A. Vellayappan
- Department of Radiation Oncology, National University Cancer Institute Singapore, National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074, Singapore
| | - Beng Chin Ooi
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore
| | - Swee Tian Quek
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Andrew Makmur
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - James Thomas Patrick Decourcy Hallinan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| |
Collapse
|
33
|
Zhang B, Dong X, Hu Y, Jiang X, Li G. Classification and prediction of spinal disease based on the SMOTE-RFE-XGBoost model. PeerJ Comput Sci 2023; 9:e1280. [PMID: 37346612 PMCID: PMC10280425 DOI: 10.7717/peerj-cs.1280] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2022] [Accepted: 02/15/2023] [Indexed: 06/23/2023]
Abstract
Spinal diseases are killers that cause long-term disturbance to people with complex and diverse symptoms and may cause other conditions. At present, the diagnosis and treatment of the main diseases mainly depend on the professional level and clinical experience of doctors, which is a breakthrough problem in the field of medicine. This article proposes the SMOTE-RFE-XGBoost model, which takes the physical angle of human bone as the research index for feature selection and classification model construction to predict spinal diseases. The research process is as follows: two groups of people with normal and abnormal spine conditions are taken as the research objects of this article, and the synthetic minority oversampling technique (SMOTE) algorithm is used to address category imbalance. Three methods, least absolute shrinkage and selection operator (LASSO), tree-based feature selection, and recursive feature elimination (RFE), are used for feature selection. Logistic regression (LR), support vector machine (SVM), parsimonious Bayes, decision tree (DT), random forest (RF), gradient boosting tree (GBT), extreme gradient boosting (XGBoost), and ridge regression models are used to classify the samples, construct single classification models and combine classification models and rank the feature importance. According to the accuracy and mean square error (MSE) values, the SMOTE-RFE-XGBoost combined model has the best classification, with accuracy, MSE and F1 values of 97.56%, 0.1111 and 0.8696, respectively. The importance of four indicators, lumbar slippage, cervical tilt, pelvic radius and pelvic tilt, was higher.
Collapse
Affiliation(s)
- Biao Zhang
- School of Computer Science, Liaocheng University, Liaocheng, Shandong, China
| | - Xinyan Dong
- School of Statistics and Mathematics, Zhongnan University of Economics and Law, Wuhan, Hubei, China
| | - Yuwei Hu
- School of Statistics and Mathematics, Zhongnan University of Economics and Law, Wuhan, Hubei, China
| | - Xuchu Jiang
- School of Statistics and Mathematics, Zhongnan University of Economics and Law, Wuhan, Hubei, China
| | - Gongchi Li
- Union Hospital Affiliated to Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
| |
Collapse
|
34
|
Zhong J, Hu Y, Ge X, Xing Y, Ding D, Zhang G, Zhang H, Yang Q, Yao W. A systematic review of radiomics in chondrosarcoma: assessment of study quality and clinical value needs handy tools. Eur Radiol 2023; 33:1433-1444. [PMID: 36018355 DOI: 10.1007/s00330-022-09060-3] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 06/24/2022] [Accepted: 07/24/2022] [Indexed: 02/03/2023]
Abstract
OBJECTIVE To evaluate the study quality and clinical value of radiomics studies on chondrosarcoma. METHODS PubMed, Embase, Web of Science, China National Knowledge Infrastructure, and Wanfang Data were searched for articles on radiomics for evaluating chondrosarcoma as of January 31, 2022. The study quality was assessed according to Radiomics Quality Score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) checklist, Image Biomarker Standardization Initiative (IBSI) guideline, and modified Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. The level of evidence supporting clinical use of radiomics on chondrosarcoma differential diagnosis was determined based on meta-analyses. RESULTS Twelve articles were included. The median RQS was 10.5 (range, -3 to 15), with an adherence rate of 36%. The adherence rate was extremely low in domains of high-level evidence (0%), open science and data (17%), and imaging and segmentation (35%). The adherence rate of the TRIPOD checklist was 61%, and low for section of title and abstract (13%), introduction (42%), and results (56%). The reporting rate of pre-processing steps according to the IBSI guideline was 60%. The risk of bias and concern of application were mainly related to the index test. The meta-analysis on differential diagnosis of enchondromas vs. chondrosarcomas showed a diagnostic odds ratio of 43.90 (95% confidential interval, 25.33-76.10), which was rated as weak evidence. CONCLUSIONS The current scientific and reporting quality of radiomics studies on chondrosarcoma was insufficient. Radiomics has potential in facilitating the optimization of operation decision-making in chondrosarcoma. KEY POINTS • Among radiomics studies on chondrosarcoma, although differential diagnostic models showed promising performance, only pieces of weak level of evidence were reached with insufficient study quality. • Since the RQS rating, the TRIPOD checklist, and the IBSI guideline have largely overlapped with each other, it is necessary to establish one widely acceptable methodological and reporting guideline for radiomics research. • The TRIPOD model typing, the phase classification of image mining studies, and the level of evidence category are useful tools to assess the gap between academic research and clinical application, although their modifications for radiomics studies are needed.
Collapse
Affiliation(s)
- Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China
| | - Xiang Ge
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China
| | - Defang Ding
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China
| | - Guangcheng Zhang
- Department of Sports Medicine, Shanghai Jiao Tong University Affiliated Sixth People's Hospital, No. 600 Yishan Road, Shanghai, 200233, China
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, No. 197 Ruijin 2nd Road, Shanghai, 200025, China
| | - Qingcheng Yang
- Department of Orthopedics, Shanghai Jiao Tong University Affiliated Sixth People's Hospital, No. 600 Yishan Road, Shanghai, 200233, China.
| | - Weiwu Yao
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China.
| |
Collapse
|
35
|
Li X, Lan M, Wang X, Zhang J, Gong L, Liao F, Lin H, Dai S, Fan B, Dong W. Development and validation of a MRI-based combined radiomics nomogram for differentiation in chondrosarcoma. Front Oncol 2023; 13:1090229. [PMID: 36925933 PMCID: PMC10012421 DOI: 10.3389/fonc.2023.1090229] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Accepted: 02/13/2023] [Indexed: 03/08/2023] Open
Abstract
Objective This study aims to develop and validate the performance of an unenhanced magnetic resonance imaging (MRI)-based combined radiomics nomogram for discrimination between low-grade and high-grade in chondrosarcoma. Methods A total of 102 patients with 44 in low-grade and 58 in high-grade chondrosarcoma were enrolled and divided into training set (n=72) and validation set (n=30) with a 7:3 ratio in this retrospective study. The demographics and unenhanced MRI imaging characteristics of the patients were evaluated to develop a clinic-radiological factors model. Radiomics features were extracted from T1-weighted (T1WI) images to construct radiomics signature and calculate radiomics score (Rad-score). According to multivariate logistic regression analysis, a combined radiomics nomogram based on MRI was constructed by integrating radiomics signature and independent clinic-radiological features. The performance of the combined radiomics nomogram was evaluated in terms of calibration, discrimination, and clinical usefulness. Results Using multivariate logistic regression analysis, only one clinic-radiological feature (marrow edema OR=0.29, 95% CI=0.11-0.76, P=0.012) was found to be independent predictors of differentiation in chondrosarcoma. Combined with the above clinic-radiological predictor and the radiomics signature constructed by LASSO [least absolute shrinkage and selection operator], a combined radiomics nomogram based on MRI was constructed, and its predictive performance was better than that of clinic-radiological factors model and radiomics signature, with the AUC [area under the curve] of the training set and the validation set were 0.78 (95%CI =0.67-0.89) and 0.77 (95%CI =0.59-0.94), respectively. DCA [decision curve analysis] showed that combined radiomics nomogram has potential clinical application value. Conclusion The MRI-based combined radiomics nomogram is a noninvasive preoperative prediction tool that combines clinic-radiological feature and radiomics signature and shows good predictive effect in distinguishing low-grade and high-grade bone chondrosarcoma, which may help clinicians to make accurate treatment plans.
Collapse
Affiliation(s)
- Xiaofen Li
- Medical College of Nanchang University, Nanchang, China.,Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Min Lan
- Department of Orthopedics, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Xiaolian Wang
- Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Jingkun Zhang
- Department of Radiology, The Affiliated Hospital of Jiangxi University of Traditional Chinese Medicine, Nanchang, China
| | - Lianggeng Gong
- Department of Medical Imaging Center, Second Affiliated Hospital of Nanchang University, Nanchang, China
| | - Fengxiang Liao
- Department of Nuclear Medicine, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Huashan Lin
- Department of Pharmaceutical Diagnosis, General Electric Healthcare, Changsha, China
| | - Shixiang Dai
- Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Bing Fan
- Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Wentao Dong
- Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| |
Collapse
|
36
|
Radiomics and Deep Learning for Disease Detection in Musculoskeletal Radiology: An Overview of Novel MRI- and CT-Based Approaches. Invest Radiol 2023; 58:3-13. [PMID: 36070548 DOI: 10.1097/rli.0000000000000907] [Citation(s) in RCA: 37] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
ABSTRACT Radiomics and machine learning-based methods offer exciting opportunities for improving diagnostic performance and efficiency in musculoskeletal radiology for various tasks, including acute injuries, chronic conditions, spinal abnormalities, and neoplasms. While early radiomics-based methods were often limited to a smaller number of higher-order image feature extractions, applying machine learning-based analytic models, multifactorial correlations, and classifiers now permits big data processing and testing thousands of features to identify relevant markers. A growing number of novel deep learning-based methods describe magnetic resonance imaging- and computed tomography-based algorithms for diagnosing anterior cruciate ligament tears, meniscus tears, articular cartilage defects, rotator cuff tears, fractures, metastatic skeletal disease, and soft tissue tumors. Initial radiomics and deep learning techniques have focused on binary detection tasks, such as determining the presence or absence of a single abnormality and differentiation of benign versus malignant. Newer-generation algorithms aim to include practically relevant multiclass characterization of detected abnormalities, such as typing and malignancy grading of neoplasms. So-called delta-radiomics assess tumor features before and after treatment, with temporal changes of radiomics features serving as surrogate markers for tumor responses to treatment. New approaches also predict treatment success rates, surgical resection completeness, and recurrence risk. Practice-relevant goals for the next generation of algorithms include diagnostic whole-organ and advanced classification capabilities. Important research objectives to fill current knowledge gaps include well-designed research studies to understand how diagnostic performances and suggested efficiency gains of isolated research settings translate into routine daily clinical practice. This article summarizes current radiomics- and machine learning-based magnetic resonance imaging and computed tomography approaches for musculoskeletal disease detection and offers a perspective on future goals and objectives.
Collapse
|
37
|
Gitto S, Corino VDA, Annovazzi A, Milazzo Machado E, Bologna M, Marzorati L, Albano D, Messina C, Serpi F, Anelli V, Ferraresi V, Zoccali C, Aliprandi A, Parafioriti A, Luzzati A, Biagini R, Mainardi L, Sconfienza LM. 3D vs. 2D MRI radiomics in skeletal Ewing sarcoma: Feature reproducibility and preliminary machine learning analysis on neoadjuvant chemotherapy response prediction. Front Oncol 2022; 12:1016123. [PMID: 36531029 PMCID: PMC9755864 DOI: 10.3389/fonc.2022.1016123] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Accepted: 11/17/2022] [Indexed: 07/29/2023] Open
Abstract
OBJECTIVE The extent of response to neoadjuvant chemotherapy predicts survival in Ewing sarcoma. This study focuses on MRI radiomics of skeletal Ewing sarcoma and aims to investigate feature reproducibility and machine learning prediction of response to neoadjuvant chemotherapy. MATERIALS AND METHODS This retrospective study included thirty patients with biopsy-proven skeletal Ewing sarcoma, who were treated with neoadjuvant chemotherapy before surgery at two tertiary sarcoma centres. 7 patients were poor responders and 23 were good responders based on pathological assessment of the surgical specimen. On pre-treatment T1-weighted and T2-weighted MRI, 2D and 3D tumour segmentations were manually performed. Features were extracted from original and wavelet-transformed images. Feature reproducibility was assessed through small geometrical transformations of the regions of interest mimicking multiple manual delineations, and intraclass correlation coefficient >0.75 defined feature reproducibility. Feature selection also consisted of collinearity and significance analysis. After class balancing in the training cohort, three machine learning classifiers were trained and tested on unseen data using hold-out cross-validation. RESULTS 1303 (77%) 3D and 620 (65%) 2D radiomic features were reproducible. 4 3D and 4 2D features passed feature selection. Logistic regression built upon 3D features achieved the best performance with 85% accuracy (AUC=0.9) in predicting response to neoadjuvant chemotherapy. CONCLUSION Compared to 2D approach, 3D MRI radiomics of Ewing sarcoma had superior reproducibility and higher accuracy in predicting response to neoadjuvant chemotherapy, particularly when using logistic regression classifier.
Collapse
Affiliation(s)
- Salvatore Gitto
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | - Valentina D. A. Corino
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico Di Milano, Milan, Italy
- Cardiotech Lab, Centro Cardiologico Monzino IRCCS, Milan, Italy
| | - Alessio Annovazzi
- Nuclear Medicine Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | | | - Marco Bologna
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico Di Milano, Milan, Italy
| | - Lorenzo Marzorati
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico Di Milano, Milan, Italy
| | | | - Carmelo Messina
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Francesca Serpi
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | - Vincenzo Anelli
- Radiology and Diagnostic Imaging Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Virginia Ferraresi
- Sarcomas and Rare Tumours Departmental Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Carmine Zoccali
- Department of Anatomical, Histological, Forensic and Musculoskeletal System Sciences, Sapienza University of Rome, Rome, Italy
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | | | | | | | - Roberto Biagini
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Luca Mainardi
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico Di Milano, Milan, Italy
| | - Luca Maria Sconfienza
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| |
Collapse
|
38
|
Yan L, Gao N, Ai F, Zhao Y, Kang Y, Chen J, Weng Y. Deep learning models for predicting the survival of patients with chondrosarcoma based on a surveillance, epidemiology, and end results analysis. Front Oncol 2022; 12:967758. [PMID: 36072795 PMCID: PMC9442032 DOI: 10.3389/fonc.2022.967758] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Accepted: 07/29/2022] [Indexed: 11/13/2022] Open
Abstract
BackgroundAccurate prediction of prognosis is critical for therapeutic decisions in chondrosarcoma patients. Several prognostic models have been created utilizing multivariate Cox regression or binary classification-based machine learning approaches to predict the 3- and 5-year survival of patients with chondrosarcoma, but few studies have investigated the results of combining deep learning with time-to-event prediction. Compared with simplifying the prediction as a binary classification problem, modeling the probability of an event as a function of time by combining it with deep learning can provide better accuracy and flexibility.Materials and methodsPatients with the diagnosis of chondrosarcoma between 2000 and 2018 were extracted from the Surveillance, Epidemiology, and End Results (SEER) registry. Three algorithms—two based on neural networks (DeepSurv, neural multi-task logistic regression [NMTLR]) and one on ensemble learning (random survival forest [RSF])—were selected for training. Meanwhile, a multivariate Cox proportional hazards (CoxPH) model was also constructed for comparison. The dataset was randomly divided into training and testing datasets at a ratio of 7:3. Hyperparameter tuning was conducted through a 1000-repeated random search with 5-fold cross-validation on the training dataset. The model performance was assessed using the concordance index (C-index), Brier score, and Integrated Brier Score (IBS). The accuracy of predicting 1-, 3-, 5- and 10-year survival was evaluated using receiver operating characteristic curves (ROC), calibration curves, and the area under the ROC curves (AUC).ResultsA total of 3145 patients were finally enrolled in our study. The mean age at diagnosis was 52 ± 18 years, 1662 of the 3145 patients were male (53%), and mean survival time was 83 ± 67 months. Two deep learning models outperformed the RSF and classical CoxPH models, with the C-index on test datasets achieving values of 0.832 (DeepSurv) and 0.821 (NMTLR). The DeepSurv model produced better accuracy and calibrated survival estimates in predicting 1-, 3- 5- and 10-year survival (AUC:0.895-0.937). We deployed the DeepSurv model as a web application for use in clinical practice; it can be accessed through https://share.streamlit.io/whuh-ml/chondrosarcoma/Predict/app.py.ConclusionsTime-to-event prediction models based on deep learning algorithms are successful in predicting chondrosarcoma prognosis, with DeepSurv producing the best discriminative performance and calibration.
Collapse
Affiliation(s)
- Lizhao Yan
- Department of Hand Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Nan Gao
- Department of Hand Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Fangxing Ai
- Department of Hand Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yingsong Zhao
- Department of Orthopaedics, Liyuan Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yu Kang
- Department of Hand Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Jianghai Chen
- Department of Hand Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- *Correspondence: Jianghai Chen, ; Yuxiong Weng,
| | - Yuxiong Weng
- Department of Hand Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- *Correspondence: Jianghai Chen, ; Yuxiong Weng,
| |
Collapse
|
39
|
Klontzas ME, Karantanas AH. Research in Musculoskeletal Radiology: Setting Goals and Strategic Directions. Semin Musculoskelet Radiol 2022; 26:354-358. [PMID: 35654100 DOI: 10.1055/s-0042-1748319] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
The future of musculoskeletal (MSK) radiology is being built on research developments in the field. Over the past decade, MSK imaging research has been dominated by advancements in molecular imaging biomarkers, artificial intelligence, radiomics, and novel high-resolution equipment. Adequate preparation of trainees and specialists will ensure that current and future leaders will be prepared to embrace and critically appraise technological developments, will be up to date on clinical developments, such as the use of artificial tissues, will define research directions, and will actively participate and lead multidisciplinary research. This review presents an overview of the current MSK research landscape and proposes tangible future goals and strategic directions that will fortify the future of MSK radiology.
Collapse
Affiliation(s)
- Michail E Klontzas
- Department of Medical Imaging, University Hospital of Heraklion, Crete, Greece.,Advanced Hybrid Imaging Systems, Institute of Computer Science, Foundation for Research and Technology (FORTH), Heraklion, Crete, Greece.,Department of Radiology, School of Medicine, University of Crete, Heraklion, Greece
| | - Apostolos H Karantanas
- Department of Medical Imaging, University Hospital of Heraklion, Crete, Greece.,Advanced Hybrid Imaging Systems, Institute of Computer Science, Foundation for Research and Technology (FORTH), Heraklion, Crete, Greece.,Department of Radiology, School of Medicine, University of Crete, Heraklion, Greece
| |
Collapse
|
40
|
Georgeanu VA, Mămuleanu M, Ghiea S, Selișteanu D. Malignant Bone Tumors Diagnosis Using Magnetic Resonance Imaging Based on Deep Learning Algorithms. Medicina (B Aires) 2022; 58:medicina58050636. [PMID: 35630053 PMCID: PMC9147948 DOI: 10.3390/medicina58050636] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2022] [Revised: 04/29/2022] [Accepted: 05/02/2022] [Indexed: 11/16/2022] Open
Abstract
Background and Objectives: Malignant bone tumors represent a major problem due to their aggressiveness and low survival rate. One of the determining factors for improving vital and functional prognosis is the shortening of the time between the onset of symptoms and the moment when treatment starts. The objective of the study is to predict the malignancy of a bone tumor from magnetic resonance imaging (MRI) using deep learning algorithms. Materials and Methods: The cohort contained 23 patients in the study (14 women and 9 men with ages between 15 and 80). Two pretrained ResNet50 image classifiers are used to classify T1 and T2 weighted MRI scans. To predict the malignancy of a tumor, a clinical model is used. The model is a feed forward neural network whose inputs are patient clinical data and the output values of T1 and T2 classifiers. Results: For the training step, the accuracies of 93.67% for the T1 classifier and 86.67% for the T2 classifier were obtained. In validation, both classifiers obtained 95.00% accuracy. The clinical model had an accuracy of 80.84% for training phase and 80.56% for validation. The receiver operating characteristic curve (ROC) of the clinical model shows that the algorithm can perform class separation. Conclusions: The proposed method is based on pretrained deep learning classifiers which do not require a manual segmentation of the MRI images. These algorithms can be used to predict the malignancy of a tumor and on the other hand can shorten the time of their diagnosis and treatment process. While the proposed method requires minimal intervention from an imagist, it needs to be tested on a larger cohort of patients.
Collapse
Affiliation(s)
- Vlad Alexandru Georgeanu
- Department of General Medicine, “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania;
- Orthopaedics and Trauma Surgery Department, “St. Pantelimon” Hospital, 021659 Bucharest, Romania
| | - Mădălin Mămuleanu
- Department of Automatic Control and Electronics, University of Craiova, 200585 Craiova, Romania;
- Oncometrics S.R.L., 200677 Craiova, Romania
- Correspondence: ; Tel.: +40-762-893-723
| | | | - Dan Selișteanu
- Department of Automatic Control and Electronics, University of Craiova, 200585 Craiova, Romania;
| |
Collapse
|
41
|
Diffusion-weighted MRI radiomics of spine bone tumors: feature stability and machine learning-based classification performance. Radiol Med 2022; 127:518-525. [PMID: 35320464 PMCID: PMC9098537 DOI: 10.1007/s11547-022-01468-7] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2021] [Accepted: 02/11/2022] [Indexed: 10/29/2022]
Abstract
PURPOSE To evaluate stability and machine learning-based classification performance of radiomic features of spine bone tumors using diffusion- and T2-weighted magnetic resonance imaging (MRI). MATERIAL AND METHODS This retrospective study included 101 patients with histology-proven spine bone tumor (22 benign; 38 primary malignant; 41 metastatic). All tumor volumes were manually segmented on morphologic T2-weighted sequences. The same region of interest (ROI) was used to perform radiomic analysis on ADC map. A total of 1702 radiomic features was considered. Feature stability was assessed through small geometrical transformations of the ROIs mimicking multiple manual delineations. Intraclass correlation coefficient (ICC) quantified feature stability. Feature selection consisted of stability-based (ICC > 0.75) and significance-based selections (ranking features by decreasing Mann-Whitney p-value). Class balancing was performed to oversample the minority (i.e., benign) class. Selected features were used to train and test a support vector machine (SVM) to discriminate benign from malignant spine tumors using tenfold cross-validation. RESULTS A total of 76.4% radiomic features were stable. The quality metrics for the SVM were evaluated as a function of the number of selected features. The radiomic model with the best performance and the lowest number of features for classifying tumor types included 8 features. The metrics were 78% sensitivity, 68% specificity, 76% accuracy and AUC 0.78. CONCLUSION SVM classifiers based on radiomic features extracted from T2- and diffusion-weighted imaging with ADC map are promising for classification of spine bone tumors. Radiomic features of spine bone tumors show good reproducibility rates.
Collapse
|
42
|
Radiomics of Musculoskeletal Sarcomas: A Narrative Review. J Imaging 2022; 8:jimaging8020045. [PMID: 35200747 PMCID: PMC8876222 DOI: 10.3390/jimaging8020045] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Revised: 01/31/2022] [Accepted: 02/10/2022] [Indexed: 12/23/2022] Open
Abstract
Bone and soft-tissue primary malignant tumors or sarcomas are a large, diverse group of mesenchymal-derived malignancies. They represent a model for intra- and intertumoral heterogeneities, making them particularly suitable for radiomics analyses. Radiomic features offer information on cancer phenotype as well as the tumor microenvironment which, combined with other pertinent data such as genomics and proteomics and correlated with outcomes data, can produce accurate, robust, evidence-based, clinical-decision support systems. Our purpose in this narrative review is to offer an overview of radiomics studies dealing with Magnetic Resonance Imaging (MRI)-based radiomics models of bone and soft-tissue sarcomas that could help distinguish different histotypes, low-grade from high-grade sarcomas, predict response to multimodality therapy, and thus better tailor patients’ treatments and finally improve their survivals. Although showing promising results, interobserver segmentation variability, feature reproducibility, and model validation are three main challenges of radiomics that need to be addressed in order to translate radiomics studies to clinical applications. These efforts, together with a better knowledge and application of the “Radiomics Quality Score” and Image Biomarker Standardization Initiative reporting guidelines, could improve the quality of sarcoma radiomics studies and facilitate radiomics towards clinical translation.
Collapse
|