Development of machine learning model algorithm for prediction of 5-year soft tissue myxoid liposarcoma survival

Machine Learning-Assisted Decision Making in Orthopaedic Oncology

» Artificial intelligence is an umbrella term for computational calculations that are designed to mimic human intelligence and problem-solving capabilities, although in the future, this may become an incomplete definition. Machine learning (ML) encompasses the development of algorithms or predictive models that generate outputs without explicit instructions, assisting in clinical predictions based on large data sets. Deep learning is a subset of ML that utilizes layers of networks that use various inter-relational connections to define and generalize data.» ML algorithms can enhance radiomics techniques for improved image evaluation and diagnosis. While ML shows promise with the advent of radiomics, there are still obstacles to overcome.» Several calculators leveraging ML algorithms have been developed to predict survival in primary sarcomas and metastatic bone disease utilizing patient-specific data. While these models often report exceptionally accurate performance, it is crucial to evaluate their robustness using standardized guidelines.» While increased computing power suggests continuous improvement of ML algorithms, these advancements must be balanced against challenges such as diversifying data, addressing ethical concerns, and enhancing model interpretability.

Prediction of 5-year survival in soft tissue leiomyosarcoma using a machine learning model algorithm

BACKGROUND AND OBJECTIVES

Leiomyosarcoma (LMS) is associated with one of the poorest overall survivals among soft tissue sarcomas. We sought to develop and externally validate a model for 5-year survival prediction in patients with appendicular or truncal LMS using machine learning algorithms.

METHODS

The Surveillance, Epidemiology, and End Results (SEER) database was used for development and internal validation of the models; external validation was assessed using our institutional database. Five machine learning algorithms were developed and then tested on our institutional database. Area under the receiver operating characteristic curve (AUC) and Brier score were used to assess model performance.

RESULTS

A total of 2209 patients from the SEER database and 81 patients from our tertiary institution were included. All models had excellent calibration with AUC 0.84-0.85 and Brier score 0.15-0.16. After assessing the performance indicators according to the TRIPOD model, we found that the Elastic-Net Penalized Logistic Regression outperformed other models. The AUCs of the institutional data were 0.83 (imputed) and 0.85 (complete-case analysis) with a Brier score of 0.16.

CONCLUSION

Our study successfully developed five machine learning algorithms to assess 5-year survival in patients with LMS. The Elastic-Net Penalized Logistic Regression retained performance upon external validation with an AUC of 0.85 and Brier score of 0.15.

Development and external validation of a machine learning model for prediction of survival in undifferentiated pleomorphic sarcoma

PURPOSE

Machine learning (ML) algorithms to predict cancer survival have recently been reported for a number of sarcoma subtypes, but none have investigated undifferentiated pleomorphic sarcoma (UPS). ML is a powerful tool that has the potential to better prognosticate UPS.

METHODS

The Surveillance, Epidemiology, and End Results (SEER) database was queried for cases of histologically confirmed undifferentiated pleomorphic sarcoma (UPS) (n = 665). Patient, tumor, and treatment characteristics were recorded, and ML models were developed to predict 1-, 3-, and 5-year survival. The best performing ML model was externally validated using an institutional cohort of UPS patients (n = 151).

RESULTS

All ML models performed best at the 1-year time point and worst at the 5-year time point. On internal validation within the SEER cohort, the best models had c-statistics of 0.67-0.69 at the 5-year time point. The Multi-Layer Perceptron Neural Network (MLP) model was the best performing model and used for external validation. Similarly, the MLP model performed best at 1-year and worst at 5-year on external validation with c-statistics of 0.85 and 0.81, respectively. The MLP model was well calibrated on external validation. The MLP model has been made publicly available at https://rachar.shinyapps.io/ups_app/ .

CONCLUSION

Machine learning models perform well for survival prediction in UPS, though this sarcoma subtype may be more difficult to prognosticate than other subtypes. Future studies are needed to further validate the machine learning approach for UPS prognostication.

New perspectives on cancer clinical research in the era of big data and machine learning

In the 21st century, the development of medical science has entered the era of big data, and machine learning has become an essential tool for mining medical big data. The establishment of the SEER database has provided a wealth of epidemiological data for cancer clinical research, and the number of studies based on SEER and machine learning has been growing in recent years. This article reviews recent research based on SEER and machine learning and finds that the current focus of such studies is primarily on the development and validation of models using machine learning algorithms, with the main directions being lymph node metastasis prediction, distant metastasis prediction, and prognosis-related research. Compared to traditional models, machine learning algorithms have the advantage of stronger adaptability, but also suffer from disadvantages such as overfitting and poor interpretability, which need to be weighed in practical applications. At present, machine learning algorithms, as the foundation of artificial intelligence, have just begun to emerge in the field of cancer clinical research. The future development of oncology will enter a more precise era of cancer research, characterized by larger data, higher dimensions, and more frequent information exchange. Machine learning is bound to shine brightly in this field.

Artificial Intelligence for Automated Implant Identification in Total Hip Arthroplasty: A Multicenter External Validation Study Exceeding Two Million Plain Radiographs

BACKGROUND

The surgical management of complications after total hip arthroplasty (THA) necessitates accurate identification of the femoral implant manufacturer and model. Automated image processing using deep learning has been previously developed and internally validated; however, external validation is necessary prior to responsible application of artificial intelligence (AI)-based technologies.

METHODS

We trained, validated, and externally tested a deep learning system to classify femoral-sided THA implants as one of the 8 models from 2 manufacturers derived from 2,954 original, deidentified, retrospectively collected anteroposterior plain radiographs across 3 academic referral centers and 13 surgeons. From these radiographs, 2,117 were used for training, 249 for validation, and 588 for external testing. Augmentation was applied to the training set (n = 2,117,000) to increase model robustness. Performance was evaluated by area under the receiver operating characteristic curve, sensitivity, specificity, and accuracy. Implant identification processing speed was calculated.

RESULTS

The training and testing sets were drawn from statistically different populations of implants (P < .001). After 1,000 training epochs by the deep learning system, the system discriminated 8 implant models with a mean area under the receiver operating characteristic curve of 0.991, accuracy of 97.9%, sensitivity of 88.6%, and specificity of 98.9% in the external testing dataset of 588 anteroposterior radiographs. The software classified implants at a mean speed of 0.02 seconds per image.

CONCLUSION

An AI-based software demonstrated excellent internal and external validation. Although continued surveillance is necessary with implant library expansion, this software represents responsible and meaningful clinical application of AI with immediate potential to globally scale and assist in preoperative planning prior to revision THA.

Predicting five-year mortality in soft-tissue sarcoma patients

Aims

The aim of this study was to identify factors associated with five-year cancer-related mortality in patients with limb and trunk soft-tissue sarcoma (STS) and develop and validate machine learning algorithms in order to predict five-year cancer-related mortality in these patients.

Methods

Demographic, clinicopathological, and treatment variables of limb and trunk STS patients in the Surveillance, Epidemiology, and End Results Program (SEER) database from 2004 to 2017 were analyzed. Multivariable logistic regression was used to determine factors significantly associated with five-year cancer-related mortality. Various machine learning models were developed and compared using area under the curve (AUC), calibration, and decision curve analysis. The model that performed best on the SEER testing data was further assessed to determine the variables most important in its predictive capacity. This model was externally validated using our institutional dataset.

Results

A total of 13,646 patients with STS from the SEER database were included, of whom 35.9% experienced five-year cancer-related mortality. The random forest model performed the best overall and identified tumour size as the most important variable when predicting mortality in patients with STS, followed by M stage, histological subtype, age, and surgical excision. Each variable was significant in logistic regression. External validation yielded an AUC of 0.752.

Conclusion

This study identified clinically important variables associated with five-year cancer-related mortality in patients with limb and trunk STS, and developed a predictive model that demonstrated good accuracy and predictability. Orthopaedic oncologists may use these findings to further risk-stratify their patients and recommend an optimal course of treatment.

Myxoid Liposarcoma: How to Stage and Follow

OPINION STATEMENT

Myxoid liposarcoma (MLPS) is a rare soft tissue sarcoma, with propensity to metastasize to locations such as soft tissue and bone. Thus, whole-body MRI should be a consideration as part of staging for patients with a new diagnosis of MLPS since PET and CT may not identify extrapulmonary disease. Surveillance imaging should be tailored, with consideration of more frequent and longer duration of monitoring for large tumors or tumors with round cell component. This review focuses on studies evaluating imaging in MLPS as well as recent publications on survival and prognostic tools in MLPS.

Artificial intelligence applied to musculoskeletal oncology: a systematic review

Developments in artificial intelligence have the potential to improve the care of patients with musculoskeletal tumors. We performed a systematic review of the published scientific literature to identify the current state of the art of artificial intelligence applied to musculoskeletal oncology, including both primary and metastatic tumors, and across the radiology, nuclear medicine, pathology, clinical research, and molecular biology literature. Through this search, we identified 252 primary research articles, of which 58 used deep learning and 194 used other machine learning techniques. Articles involving deep learning have mostly involved bone scintigraphy, histopathology, and radiologic imaging. Articles involving other machine learning techniques have mostly involved transcriptomic analyses, radiomics, and clinical outcome prediction models using medical records. These articles predominantly present proof-of-concept work, other than the automated bone scan index for bone metastasis quantification, which has translated to clinical workflows in some regions. We systematically review and discuss this literature, highlight opportunities for multidisciplinary collaboration, and identify potentially clinically useful topics with a relative paucity of research attention. Musculoskeletal oncology is an inherently multidisciplinary field, and future research will need to integrate and synthesize noisy siloed data from across clinical, imaging, and molecular datasets. Building the data infrastructure for collaboration will help to accelerate progress towards making artificial intelligence truly useful in musculoskeletal oncology.