Novel prognostication of patients with spinal and pelvic chondrosarcoma using deep survival neural networks

Machine Learning in Spine Oncology: A Narrative Review

STUDY DESIGN

Narrative Review.

OBJECTIVE

Machine learning (ML) is one of the latest advancements in artificial intelligence used in medicine and surgery with the potential to significantly impact the way physicians diagnose, prognose, and treat spine tumors. In the realm of spine oncology, ML is utilized to analyze and interpret medical imaging and classify tumors with incredible accuracy. The authors present a narrative review that specifically addresses the use of machine learning in spine oncology.

METHODS

This study was conducted in accordance with the Preferred Reporting Items of Systematic Reviews and Meta-Analysis (PRISMA) methodology. A systematic review of the literature in the PubMed, EMBASE, Web of Science, Scopus, and Cochrane Library databases since inception was performed to present all clinical studies with the search terms '[[Machine Learning] OR [Artificial Intelligence]] AND [[Spine Oncology] OR [Spine Cancer]]'. Data included studies that were extracted and included algorithms, training and test size, outcomes reported. Studies were separated based on the type of tumor investigated using the machine learning algorithms into primary, metastatic, both, and intradural. A minimum of 2 independent reviewers conducted the study appraisal, data abstraction, and quality assessments of the studies.

RESULTS

Forty-five studies met inclusion criteria out of 480 references screened from the initial search results. Studies were grouped by metastatic, primary, and intradural tumors. The majority of ML studies relevant to spine oncology focused on utilizing a mixture of clinical and imaging features to risk stratify mortality and frailty. Overall, these studies showed that ML is a helpful tool in tumor detection, differentiation, segmentation, predicting survival, predicting readmission rates of patients with either primary, metastatic, or intradural spine tumors.

CONCLUSION

Specialized neural networks and deep learning algorithms have shown to be highly effective at predicting malignant probability and aid in diagnosis. ML algorithms can predict the risk of tumor recurrence or progression based on imaging and clinical features. Additionally, ML can optimize treatment planning, such as predicting radiotherapy dose distribution to the tumor and surrounding normal tissue or in surgical resection planning. It has the potential to significantly enhance the accuracy and efficiency of health care delivery, leading to improved patient outcomes.

Machine Learning Predict Survivals of Spinal and Pelvic Ewing's Sarcoma with the SEER Database

STUDY DESIGN

Retrospective Cohort Study.

OBJECTIVES

This study aimed to develop survival prediction models for spinal Ewing's sarcoma (EWS) based on machine learning (ML).

METHODS

We extracted the SEER registry's clinical data of EWS diagnosed between 1975 and 2016. Three feature selection methods extracted clinical features. Four ML algorithms (Cox, random survival forest (RSF), CoxBoost, DeepCox) were trained to predict the overall survival (OS) and cancer-specific survival (CSS) of spinal EWS. The concordance index (C-index), integrated Brier score (IBS) and mean area under the curves (AUC) were used to assess the prediction performance of different ML models. The top initial ML models with best performance from each evaluation index (C-index, IBS and mean AUC) were finally stacked to ensemble models which were compared with the traditional TNM stage model by 3-/5-/10-year Receiver Operating Characteristic (ROC) curves and Decision Curve Analysis (DCA).

RESULTS

A total of 741 patients with spinal EWS were identified. C-index, IBS and mean AUC for the final ensemble ML model in predicting OS were .693/0.158/0.829 during independent testing, while .719/0.171/0.819 in predicting CSS. The ensemble ML model also achieved an AUC of .705/0.747/0.851 for predicting 3-/5-/10-year OS during independent testing, while .734/0.779/0.830 for predicting 3-/5-/10-year CSS, both of which outperformed the traditional TNM stage. DCA curves also showed the advantages of the ensemble models over the traditional TNM stage.

CONCLUSION

ML was an effective and promising technique in predicting survival of spinal EWS, and the ensemble models were superior to the traditional TNM stage model.

New perspectives on cancer clinical research in the era of big data and machine learning

In the 21st century, the development of medical science has entered the era of big data, and machine learning has become an essential tool for mining medical big data. The establishment of the SEER database has provided a wealth of epidemiological data for cancer clinical research, and the number of studies based on SEER and machine learning has been growing in recent years. This article reviews recent research based on SEER and machine learning and finds that the current focus of such studies is primarily on the development and validation of models using machine learning algorithms, with the main directions being lymph node metastasis prediction, distant metastasis prediction, and prognosis-related research. Compared to traditional models, machine learning algorithms have the advantage of stronger adaptability, but also suffer from disadvantages such as overfitting and poor interpretability, which need to be weighed in practical applications. At present, machine learning algorithms, as the foundation of artificial intelligence, have just begun to emerge in the field of cancer clinical research. The future development of oncology will enter a more precise era of cancer research, characterized by larger data, higher dimensions, and more frequent information exchange. Machine learning is bound to shine brightly in this field.

Machine learning algorithms being an auxiliary tool to predict the overall survival of patients with renal cell carcinoma using the SEER database

Background

The clinical prognosis assessment of renal cell carcinoma (RCC) still relies on nuclear grading and nuclear score by naked eye with microscope, which has defects long time, low efficiency, and uneven evaluation level criteria. There are few machine learning (ML) studies investigating the prognosis in the RCC literature which could also quantify the risk of postoperative recurrence of RCC patients and guide cancer patients to conduct individualized postoperative clinical management. This study evaluated the suitability of ML algorithms for survival prediction in patients with RCC.

Methods

A total of 192,912 RCC patients from the Surveillance, Epidemiology, and End Results (SEER) were obtained from 2004 to 2015. Six ML algorithms including support vector machine (SVM), Bayesian method, decision tree, random forest, neural network, and Extreme Gradient Boosting (XGBoost) were applied to predict overall survival (OS) of RCC.

Results

Patients from the SEER with a median age of 62 years and the pathological types were clear cell RCC (47.6%), papillary RCC (9.5%), chromophobe RCC (4.0%) and others (4.1%) were collected. In the deleting patients with missing data, the highest accurate model was XGBoost [area under the curve (AUC) 67.0%]. In the deleting patients with missing data and survival time <5 years, the accuracy of random forest, neural network and XGBoost were high, with AUC of 80.8%, 81.5% and 81.8%, respectively. In the only deleting the missing tumor diameter and filling the missing dataset with missForest, the highest accurate model was random forest (AUC: 71.9%). In this study, the overall accuracy of the SVM model was not high, apart from in the population of patients with deleting the missing tumor diameter and survival time <5 years, and filling the missing data with missForest. Random forest, neural network and XGBoost had high accuracy, with AUC of 84.1%, 84.7% and 84.8%, respectively.

Conclusions

ML algorithms could be used to predict the prognosis of RCC. It could quantify the recurrence possibility of patients and help more individualized postoperative clinical management. Given the limitations and complexity of datasets, ML may be used as an auxiliary tool to analyze and process larger datasets and complex data.

Survival prediction of glioblastoma patients using modern deep learning and machine learning techniques

In this study, we utilized data from the Surveillance, Epidemiology, and End Results (SEER) database to predict the glioblastoma patients' survival outcomes. To assess dataset skewness and detect feature importance, we applied Pearson's second coefficient test of skewness and the Ordinary Least Squares method, respectively. Using two sampling strategies, holdout and five-fold cross-validation, we developed five machine learning (ML) models alongside a feed-forward deep neural network (DNN) for the multiclass classification and regression prediction of glioblastoma patient survival. After balancing the classification and regression datasets, we obtained 46,340 and 28,573 samples, respectively. Shapley additive explanations (SHAP) were then used to explain the decision-making process of the best model. In both classification and regression tasks, as well as across holdout and cross-validation sampling strategies, the DNN consistently outperformed the ML models. Notably, the accuracy were 90.25% and 90.22% for holdout and five-fold cross-validation, respectively, while the corresponding R2 values were 0.6565 and 0.6622. SHAP analysis revealed the importance of age at diagnosis as the most influential feature in the DNN's survival predictions. These findings suggest that the DNN holds promise as a practical auxiliary tool for clinicians, aiding them in optimal decision-making concerning the treatment and care trajectories for glioblastoma patients.

Machine Learning in Spine Surgery: A Narrative Review

Artificial intelligence and machine learning (ML) can offer revolutionary advances in their application to the field of spine surgery. Within the past 5 years, novel applications of ML have assisted in surgical decision-making, intraoperative imaging and navigation, and optimization of clinical outcomes. ML has the capacity to address many different clinical needs and improve diagnostic and surgical techniques. This review will discuss current applications of ML in the context of spine surgery by breaking down its implementation preoperatively, intraoperatively, and postoperatively. Ethical considerations to ML and challenges in ML implementation must be addressed to maximally benefit patients, spine surgeons, and the healthcare system. Areas for future research in augmented reality and mixed reality, along with limitations in generalizability and bias, will also be highlighted.

Applications of artificial intelligence in orthopaedic surgery

The practice of medicine is rapidly transforming as a result of technological breakthroughs. Artificial intelligence (AI) systems are becoming more and more relevant in medicine and orthopaedic surgery as a result of the nearly exponential growth in computer processing power, cloud based computing, and development, and refining of medical-task specific software algorithms. Because of the extensive role of technologies such as medical imaging that bring high sensitivity, specificity, and positive/negative prognostic value to management of orthopaedic disorders, the field is particularly ripe for the application of machine-based integration of imaging studies, among other applications. Through this review, we seek to promote awareness in the orthopaedics community of the current accomplishments and projected uses of AI and ML as described in the literature. We summarize the current state of the art in the use of ML and AI in five key orthopaedic disciplines: joint reconstruction, spine, orthopaedic oncology, trauma, and sports medicine.

Current Applications of Machine Learning in Spine: From Clinical View

STUDY DESIGN

Narrative review.

OBJECTIVES

This review aims to present current applications of machine learning (ML) in spine domain to clinicians.

METHODS

We conducted a comprehensive PubMed search of peer-reviewed articles that were published between 2006 and 2020 using terms (spine, spinal, lumbar, cervical, thoracic, machine learning) to examine ML in spine. Then exclude research of other domain, case report, review or meta-analysis, and which without available abstract or full text.

RESULTS

Total 1738 articles were retrieved from database, and 292 studies were finally included. Key findings of current applications were compiled and summarized in this review. Main clinical applications of those techniques including image processing, diagnosis, decision supporting, operative assistance, rehabilitation, surgery outcomes, complications, hospitalization and cost.

CONCLUSIONS

ML had achieved excellent performance and hold immense potential in spine. ML could help clinical staff to improve medical level, enhance work efficiency, and reduce adverse events. However more randomized controlled trials and improvement of interpretability are essential to clinicians accepting models' assistance in real work.

A novel deep learning prognostic system improves survival predictions for stage III non-small cell lung cancer

Background

Accurate prognostic prediction plays a crucial role in the clinical setting. However, the TNM staging system fails to provide satisfactory individual survival prediction for stage III non‐small cell lung cancer (NSCLC). The performance of the deep learning network for survival prediction in stage III NSCLC has not been explored.

Objectives

This study aimed to develop a deep learning‐based prognostic system that could achieve better predictive performance than the existing staging system for stage III NSCLC.

Methods

In this study, a deep survival learning model (DSLM) for stage III NSCLC was developed based on the Surveillance, Epidemiology, and End Results (SEER) database and was independently tested with another external cohort from our institute. DSLM was compared with the Cox proportional hazard (CPH) and random survival forest (RSF) models. A new prognostic system for stage III NSCLC was also proposed based on the established deep learning model.

Results

The study included 16,613 patients with stage III NSCLC from the SEER database. DSLM showed the best performance in survival prediction, with a C‐index of 0.725 in the validation set, followed by RSF (0.688) and CPH (0.683). DSLM also showed C‐indices of 0.719 and 0.665 in the internal and real‐world external testing datasets, respectively. In addition, the new prognostic system based on DSLM (AUROC = 0.744) showed better performance than the TNM staging system (AUROC = 0.561).

Conclusion

In this study, a new, integrated deep learning‐based prognostic model was developed and evaluated for stage III NSCLC. This novel approach may be valuable in improving patient stratification and potentially provide meaningful prognostic information that contributes to personalized therapy.

Artificial intelligence applied to musculoskeletal oncology: a systematic review

Developments in artificial intelligence have the potential to improve the care of patients with musculoskeletal tumors. We performed a systematic review of the published scientific literature to identify the current state of the art of artificial intelligence applied to musculoskeletal oncology, including both primary and metastatic tumors, and across the radiology, nuclear medicine, pathology, clinical research, and molecular biology literature. Through this search, we identified 252 primary research articles, of which 58 used deep learning and 194 used other machine learning techniques. Articles involving deep learning have mostly involved bone scintigraphy, histopathology, and radiologic imaging. Articles involving other machine learning techniques have mostly involved transcriptomic analyses, radiomics, and clinical outcome prediction models using medical records. These articles predominantly present proof-of-concept work, other than the automated bone scan index for bone metastasis quantification, which has translated to clinical workflows in some regions. We systematically review and discuss this literature, highlight opportunities for multidisciplinary collaboration, and identify potentially clinically useful topics with a relative paucity of research attention. Musculoskeletal oncology is an inherently multidisciplinary field, and future research will need to integrate and synthesize noisy siloed data from across clinical, imaging, and molecular datasets. Building the data infrastructure for collaboration will help to accelerate progress towards making artificial intelligence truly useful in musculoskeletal oncology.

Deep Learning for Outcome Prediction in Neurosurgery: A Systematic Review of Design, Reporting, and Reproducibility

Deep learning (DL) is a powerful machine learning technique that has increasingly been used to predict surgical outcomes. However, the large quantity of data required and lack of model interpretability represent substantial barriers to the validity and reproducibility of DL models. The objective of this study was to systematically review the characteristics of DL studies involving neurosurgical outcome prediction and to assess their bias and reporting quality. Literature search using the PubMed, Scopus, and Embase databases identified 1949 records of which 35 studies were included. Of these, 32 (91%) developed and validated a DL model while 3 (9%) validated a pre-existing model. The most commonly represented subspecialty areas were oncology (16 of 35, 46%), spine (8 of 35, 23%), and vascular (6 of 35, 17%). Risk of bias was low in 18 studies (51%), unclear in 5 (14%), and high in 12 (34%), most commonly because of data quality deficiencies. Adherence to transparent reporting of a multivariable prediction model for individual prognosis or diagnosis reporting standards was low, with a median of 12 transparent reporting of a multivariable prediction model for individual prognosis or diagnosis items (39%) per study not reported. Model transparency was severely limited because code was provided in only 3 studies (9%) and final models in 2 (6%). With the exception of public databases, no study data sets were readily available. No studies described DL models as ready for clinical use. The use of DL for neurosurgical outcome prediction remains nascent. Lack of appropriate data sets poses a major concern for bias. Although studies have demonstrated promising results, greater transparency in model development and reporting is needed to facilitate reproducibility and validation.

Artificial intelligence, machine learning, and deep learning for clinical outcome prediction

AI is a broad concept, grouping initiatives that use a computer to perform tasks that would usually require a human to complete. AI methods are well suited to predict clinical outcomes. In practice, AI methods can be thought of as functions that learn the outcomes accompanying standardized input data to produce accurate outcome predictions when trialed with new data. Current methods for cleaning, creating, accessing, extracting, augmenting, and representing data for training AI clinical prediction models are well defined. The use of AI to predict clinical outcomes is a dynamic and rapidly evolving arena, with new methods and applications emerging. Extraction or accession of electronic health care records and combining these with patient genetic data is an area of present attention, with tremendous potential for future growth. Machine learning approaches, including decision tree methods of Random Forest and XGBoost, and deep learning techniques including deep multi-layer and recurrent neural networks, afford unique capabilities to accurately create predictions from high dimensional, multimodal data. Furthermore, AI methods are increasing our ability to accurately predict clinical outcomes that previously were difficult to model, including time-dependent and multi-class outcomes. Barriers to robust AI-based clinical outcome model deployment include changing AI product development interfaces, the specificity of regulation requirements, and limitations in ensuring model interpretability, generalizability, and adaptability over time.

Clinical-Deep Neural Network and Clinical-Radiomics Nomograms for Predicting the Intraoperative Massive Blood Loss of Pelvic and Sacral Tumors

Background

Patients with pelvic and sacral tumors are prone to massive blood loss (MBL) during surgery, which may endanger their lives.

Purposes

This study aimed to determine the feasibility of using deep neural network (DNN) and radiomics nomogram (RN) based on 3D computed tomography (CT) features and clinical characteristics to predict the intraoperative MBL of pelvic and sacral tumors.

Materials and Methods

This single-center retrospective analysis included 810 patients with pelvic and sacral tumors. 1316 CT and CT enhanced radiomics features were extracted. RN1 and RN2 were constructed by random grouping and time node grouping, respectively. The DNN models were constructed for comparison with RN. Clinical factors associated with the MBL were also evaluated. The area under the receiver operating characteristic curve (AUC) and accuracy (ACC) were used to evaluate different models.

Results

Radscore, tumor type, tumor location, and sex were significant predictors of the MBL of pelvic and sacral tumors (P < 0.05), of which radscore (OR, ranging from 2.109 to 4.706, P < 0.001) was the most important. The clinical-DNN and clinical-RN performed better than DNN and RN. The best-performing clinical-DNN model based on CT features exhibited an AUC of 0.92 and an ACC of 0.97 in the training set, and an AUC of 0.92 and an ACC of 0.75 in the validation set.

Conclusions

The clinical-DNN and clinical-RN had good performance in predicting the MBL of pelvic and sacral tumors, which could be used for clinical decision-making.

Using machine learning techniques predicts prognosis of patients with Ewing sarcoma

Ewing sarcoma is one of the most common types of malignant bone tumor in children and adolescents. However, to our limited knowledge, no study exists that uses machine learning to create algorithms for the prediction of survivorship for Ewing sarcoma. About 2332 patients with Ewing sarcoma between 1975 and 2016 in the United States were identified from Surveillance, Epidemiology, and End Results (SEER) program. All patients in the data set were randomly assigned into the training set and the testing set, at a 2:8 ratio. In the training set, boosted decision tree, support vector machine, nonparametric random forest method, and neural network models were developed to predict the 5-year survivorship. The overall survival rate in 5-year follow-up of this patient cohort is 60.72%. With respect to the algorithms for both cancer specific survival and overall survival, there was slight superiority in our performance metrics favoring the random forest method over the other models for survival prediction, with 77/83% sensitivity and 91/94% specificity, respectively. The random forest method was incorporated into a freely available web-based application. This application can be accessed through https://zryan.shinyapps.io/EwingSarcoma/. Clinical Significance: To the best of our knowledge, this is the first available predictive model for predicting survival in Ewing sarcoma based on machine-learning algorithms. This study may provide orthopedic surgeons with an easily accessible prediction tool when dealing with patients suffering from Ewing sarcoma.

Fostering reproducibility and generalizability in machine learning for clinical prediction modeling in spine surgery

As the use of machine learning algorithms in the development of clinical prediction models has increased, researchers are becoming more aware of the deleterious effects that stem from the lack of reporting standards. One of the most obvious consequences is the insufficient reproducibility found in current prediction models. In an attempt to characterize methods to improve reproducibility and to allow for better clinical performance, we utilize a previously proposed taxonomy that separates reproducibility into 3 components: technical, statistical, and conceptual reproducibility. By following this framework, we discuss common errors that lead to poor reproducibility, highlight the importance of generalizability when evaluating a ML model's performance, and provide suggestions to optimize generalizability to ensure adequate performance. These efforts are a necessity before such models are applied to patient care.

Development and Validation of a Personalized Survival Prediction Model for Uterine Adenosarcoma: A Population-Based Deep Learning Study

Background

The aim was to develop a personalized survival prediction deep learning model for adenosarcoma patients using the surveillance, epidemiology and end results (SEER) database.

Methods

A total of 797 uterine adenosarcoma patients were enrolled in this study. Duplicated and useless variables were excluded, and 15 variables were selected for further analyses, including age, grade, positive lymph nodes or not, marital status, race, tumor extension, stage, and surgery or not. We created our deep survival learning (DSL) model to manipulate the data, which was randomly split into a training set (n = 519, 65%), validation set (n = 143, 18%) and testing set (n = 143, 18%). The Cox proportional hazard (CPH) model was also included comparatively. Finally, personalized survival curves were plotted for randomly selected patients.

Results

The c-index for the CPH model was 0.726, and the Brier score was 0.17. For our deep survival learning model, we achieved a c-index of 0.774 and a Brier score of 0.14 in the external testing set. In addition, the limitations of the traditional staging system were revealed, and a personalized survival prediction system based on our risk scoring grouping was developed.

Conclusions

Our study developed a deep neural network model for adenosarcoma. The performance of this model was superior to that of the traditional Cox proportional hazard model. In addition, a personalized survival prediction system was developed based on our deep survival learning model, which provided more accurate prognostic information for adenosarcoma patients.

Radiomic Machine Learning Classifiers in Spine Bone Tumors: A Multi-Software, Multi-Scanner Study

PURPOSE

Spinal lesion differential diagnosis remains challenging even in MRI. Radiomics and machine learning (ML) have proven useful even in absence of a standardized data mining pipeline. We aimed to assess ML diagnostic performance in spinal lesion differential diagnosis, employing radiomic data extracted by different software.

METHODS

Patients undergoing MRI for a vertebral lesion were retrospectively analyzed (n = 146, 67 males, 79 females; mean age 63 ± 16 years, range 8-89 years) and constituted the train (n = 100) and internal test cohorts (n = 46). Part of the latter had additional prior exams which constituted a multi-scanner, external test cohort (n = 35). Lesions were labeled as benign or malignant (2-label classification), and benign, primary malignant or metastases (3-label classification) for classification analyses. Features extracted via 3D Slicer heterogeneityCAD module (hCAD) and PyRadiomics were independently used to compare different combinations of feature selection methods and ML classifiers (n = 19).

RESULTS

In total, 90 and 1548 features were extracted by hCAD and PyRadiomics, respectively. The best feature selection method-ML algorithm combination was selected by 10 iterations of 10-fold cross-validation in the training data. For the 2-label classification ML obtained 94% accuracy in the internal test cohort, using hCAD data, and 86% in the external one. For the 3-label classification, PyRadiomics data allowed for 80% and 69% accuracy in the internal and external test sets, respectively.

CONCLUSIONS

MRI radiomics combined with ML may be useful in spinal lesion assessment. More robust pre-processing led to better consistency despite scanner and protocol heterogeneity.

Artificial Intelligence in Health Care: Current Applications and Issues

In recent years, artificial intelligence (AI) technologies have greatly advanced and become a reality in many areas of our daily lives. In the health care field, numerous efforts are being made to implement the AI technology for practical medical treatments. With the rapid developments in machine learning algorithms and improvements in hardware performances, the AI technology is expected to play an important role in effectively analyzing and utilizing extensive amounts of health and medical data. However, the AI technology has various unique characteristics that are different from the existing health care technologies. Subsequently, there are a number of areas that need to be supplemented within the current health care system for the AI to be utilized more effectively and frequently in health care. In addition, the number of medical practitioners and public that accept AI in the health care is still low; moreover, there are various concerns regarding the safety and reliability of AI technology implementations. Therefore, this paper aims to introduce the current research and application status of AI technology in health care and discuss the issues that need to be resolved.

A Review on the Use of Artificial Intelligence in Spinal Diseases

Artificial neural networks (ANNs) have been used in a wide variety of real-world applications and it emerges as a promising field across various branches of medicine. This review aims to identify the role of ANNs in spinal diseases. Literature were searched from electronic databases of Scopus and Medline from 1993 to 2020 with English publications reported on the application of ANNs in spinal diseases. The search strategy was set as the combinations of the following keywords: “artificial neural networks,” “spine,” “back pain,” “prognosis,” “grading,” “classification,” “prediction,” “segmentation,” “biomechanics,” “deep learning,” and “imaging.” The main findings of the included studies were summarized, with an emphasis on the recent advances in spinal diseases and its application in the diagnostic and prognostic procedures. According to the search strategy, a set of 3,653 articles were retrieved from Medline and Scopus databases. After careful evaluation of the abstracts, the full texts of 89 eligible papers were further examined, of which 79 articles satisfied the inclusion criteria of this review. Our review indicates several applications of ANNs in the management of spinal diseases including (1) diagnosis and assessment of spinal disease progression in the patients with low back pain, perioperative complications, and readmission rate following spine surgery; (2) enhancement of the clinically relevant information extracted from radiographic images to predict Pfirrmann grades, Modic changes, and spinal stenosis grades on magnetic resonance images automatically; (3) prediction of outcomes in lumbar spinal stenosis, lumbar disc herniation and patient-reported outcomes in lumbar fusion surgery, and preoperative planning and intraoperative assistance; and (4) its application in the biomechanical assessment of spinal diseases. The evidence suggests that ANNs can be successfully used for optimizing the diagnosis, prognosis and outcome prediction in spinal diseases. Therefore, incorporation of ANNs into spine clinical practice may improve clinical decision making.