1
|
Alimohammadi E, Fatahi E, Abdi A, Reza Bagheri S. Assessing the predictive capability of machine learning models in determining clinical outcomes for patients with cervical spondylotic myelopathy treated with laminectomy and posterior spinal fusion. Patient Saf Surg 2024; 18:21. [PMID: 38844999 PMCID: PMC11155139 DOI: 10.1186/s13037-024-00403-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Accepted: 05/27/2024] [Indexed: 06/10/2024] Open
Abstract
BACKGROUND Cervical spondylotic myelopathy (CSM) is a prevalent degenerative condition resulting from spinal cord compression and injury. Laminectomy with posterior spinal fusion (LPSF) is a commonly employed treatment approach for CSM patients. This study aimed to assess the effectiveness of machine learning models (MLMs) in predicting clinical outcomes in CSM patients undergoing LPSF. METHODS A retrospective analysis was conducted on 329 CSM patients who underwent LPSF at our institution from Jul 2017 to Jul 2023. Neurological outcomes were evaluated using the modified Japanese Orthopaedic Association (mJOA) scale preoperatively and at the final follow-up. Patients were categorized into two groups based on clinical outcomes: the favorable group (recovery rates ≥ 52.8%) and the unfavorable group (recovery rates < 52.8%). Potential predictors for poor clinical outcomes were compared between the groups. Four MLMs-random forest (RF), logistic regression (LR), support vector machine (SVM), and k-nearest neighborhood (k-NN)-were utilized to predict clinical outcome. RF model was also employed to identify factors associated with poor clinical outcome. RESULTS Out of the 329 patients, 185 were male (56.2%) and 144 were female (43.4%), with an average follow-up period of 17.86 ± 1.74 months. Among them, 267 patients (81.2%) had favorable clinical outcomes, while 62 patients (18.8%) did not achieve favorable results. Analysis using binary logistic regression indicated that age, preoperative mJOA scale, and symptom duration (p < 0.05) were independent predictors of unfavorable clinical outcomes. All models performed satisfactorily, with RF achieving the highest accuracy of 0.922. RF also displayed superior sensitivity and specificity (sensitivity = 0.851, specificity = 0.944). The Area under the Curve (AUC) values for RF, Logistic LR, SVM, and k-NN were 0.905, 0.827, 0.851, and 0.883, respectively. The RF model identified preoperative mJOA scale, age, symptom duration, and MRI signal changes as the most significant variables associated with poor clinical outcomes in descending order. CONCLUSIONS This study highlighted the effectiveness of machine learning models in predicting the clinical outcomes of CSM patients undergoing LPSF. These models have the potential to forecast clinical outcomes in this patient population, providing valuable prognostic insights for preoperative counseling and postoperative management.
Collapse
Affiliation(s)
- Ehsan Alimohammadi
- Department of Neurosurgery, Kermanshah University of Medical Sciences, Imam Reza hospital, Kermanshah, Iran.
| | - Elnaz Fatahi
- Kermanshah University of Medical Sciences, Imam Reza hospital, Kermanshah, Iran
| | - Alireza Abdi
- Kermanshah University of Medical Sciences, Imam Reza hospital, Kermanshah, Iran
| | - Seyed Reza Bagheri
- Department of Neurosurgery, Kermanshah University of Medical Sciences, Imam Reza hospital, Kermanshah, Iran
| |
Collapse
|
2
|
Arjmandnia F, Alimohammadi E. The value of machine learning technology and artificial intelligence to enhance patient safety in spine surgery: a review. Patient Saf Surg 2024; 18:11. [PMID: 38528562 DOI: 10.1186/s13037-024-00393-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Accepted: 03/15/2024] [Indexed: 03/27/2024] Open
Abstract
Machine learning algorithms have the potential to significantly improve patient safety in spine surgeries by providing healthcare professionals with valuable insights and predictive analytics. These algorithms can analyze preoperative data, such as patient demographics, medical history, and imaging studies, to identify potential risk factors and predict postoperative complications. By leveraging machine learning, surgeons can make more informed decisions, personalize treatment plans, and optimize surgical techniques to minimize risks and enhance patient outcomes. Moreover, by harnessing the power of machine learning, healthcare providers can make data-driven decisions, personalize treatment plans, and optimize surgical interventions, ultimately enhancing the quality of care in spine surgery. The findings highlight the potential of integrating artificial intelligence in healthcare settings to mitigate risks and enhance patient safety in surgical practices. The integration of machine learning holds immense potential for enhancing patient safety in spine surgeries. By leveraging advanced algorithms and predictive analytics, healthcare providers can optimize surgical decision-making, mitigate risks, and personalize treatment strategies to improve outcomes and ensure the highest standard of care for patients undergoing spine procedures. As technology continues to evolve, the future of spine surgery lies in harnessing the power of machine learning to transform patient safety and revolutionize surgical practices. The present review article was designed to discuss the available literature in the field of machine learning techniques to enhance patient safety in spine surgery.
Collapse
Affiliation(s)
- Fatemeh Arjmandnia
- Department of Aneasthesiology, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Ehsan Alimohammadi
- Department of Neurosurgery, Kermanshah University of Medical Sciences, Imam Reza Hospital, Kermanshah, Iran.
| |
Collapse
|
3
|
Toh ZA, Berg B, Han QYC, Hey HWD, Pikkarainen M, Grotle M, He HG. Clinical Decision Support System Used in Spinal Disorders: Scoping Review. J Med Internet Res 2024; 26:e53951. [PMID: 38502157 PMCID: PMC10988379 DOI: 10.2196/53951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2023] [Revised: 01/29/2024] [Accepted: 02/10/2024] [Indexed: 03/20/2024] Open
Abstract
BACKGROUND Spinal disorders are highly prevalent worldwide with high socioeconomic costs. This cost is associated with the demand for treatment and productivity loss, prompting the exploration of technologies to improve patient outcomes. Clinical decision support systems (CDSSs) are computerized systems that are increasingly used to facilitate safe and efficient health care. Their applications range in depth and can be found across health care specialties. OBJECTIVE This scoping review aims to explore the use of CDSSs in patients with spinal disorders. METHODS We used the Joanna Briggs Institute methodological guidance for this scoping review and reported according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) statement. Databases, including PubMed, Embase, Cochrane, CINAHL, Web of Science, Scopus, ProQuest, and PsycINFO, were searched from inception until October 11, 2022. The included studies examined the use of digitalized CDSSs in patients with spinal disorders. RESULTS A total of 4 major CDSS functions were identified from 31 studies: preventing unnecessary imaging (n=8, 26%), aiding diagnosis (n=6, 19%), aiding prognosis (n=11, 35%), and recommending treatment options (n=6, 20%). Most studies used the knowledge-based system. Logistic regression was the most commonly used method, followed by decision tree algorithms. The use of CDSSs to aid in the management of spinal disorders was generally accepted over the threat to physicians' clinical decision-making autonomy. CONCLUSIONS Although the effectiveness was frequently evaluated by examining the agreement between the decisions made by the CDSSs and the health care providers, comparing the CDSS recommendations with actual clinical outcomes would be preferable. In addition, future studies on CDSS development should focus on system integration, considering end user's needs and preferences, and external validation and impact studies to assess effectiveness and generalizability. TRIAL REGISTRATION OSF Registries osf.io/dyz3f; https://osf.io/dyz3f.
Collapse
Affiliation(s)
- Zheng An Toh
- National University Hospital, National University Health System, Singapore, Singapore
| | - Bjørnar Berg
- Centre for Intelligent Musculoskeletal Health, Faculty of Health Sciences, Oslo Metropolitan University, Oslo, Norway
| | | | - Hwee Weng Dennis Hey
- Division of Orthopaedic Surgery, National University Hospital, National University Health System, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Minna Pikkarainen
- Department of Rehabilitation and Health Technology, Oslo Metropolitan University, Oslo, Norway
- Martti Ahtisaari Institute, Oulu Business School, Oulu University, Oulu, Finland
- Department of Product Design, Oslo Metropolitan University, Oslo, Norway
| | - Margreth Grotle
- Centre for Intelligent Musculoskeletal Health, Faculty of Health Sciences, Oslo Metropolitan University, Oslo, Norway
- Department of Research and Innovation, Division of Clinical Neuroscience, Oslo University Hospital, Oslo, Norway
| | - Hong-Gu He
- Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| |
Collapse
|
4
|
Khan ASR, Mattei TA, Mercier PJ, Cloney M, Dahdaleh NS, Koski TR, El Tecle NE. Outcome Reporting in Spine Surgery: A Review of Historical and Emerging Trends. World Neurosurg 2023; 179:88-98. [PMID: 37480984 DOI: 10.1016/j.wneu.2023.07.067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 07/13/2023] [Accepted: 07/14/2023] [Indexed: 07/24/2023]
Abstract
The general objectives of spine surgery are to alleviate pain, restore neurologic function, and prevent or treat spinal deformities or instability. The accumulating expanse of outcome measures has allowed us to more objectively quantify these variables and, therefore, gauge the success of treatments, ultimately improving the quality of the delivered health care. It has become increasingly evident that spinal conditions and their accompanying interventions affect all aspects of a patient's life, including their physical, mental, emotional, and social well-being. This underscores the challenge of creating clinically relevant and accurate outcome measures in spine care, and the reason why there is a growing recognition of the importance of subjective measures such as patient-reported outcome measures, that consider a patients' health-related quality of life. Subjective measures provide valuable insights into patient experiences and perceptions of treatment outcomes, whereas objective measures provide a reproducible glimpse into key radiographic and clinical parameters that are associated with a successful outcome. In this narrative review, we provide a detailed analysis of the most common subjective and objective outcome measures employed in spine surgery, with a special focus on their current role as well as the possible future of outcome reporting.
Collapse
Affiliation(s)
- Ali Saif R Khan
- Center School of Medicine, Texas Tech University Health Sciences Center, Lubbock, Texas, USA
| | - Tobias A Mattei
- Department of Neurological Surgery, Saint Louis University, St. Louis, Missouri, USA
| | - Phillipe J Mercier
- Department of Neurological Surgery, Saint Louis University, St. Louis, Missouri, USA
| | - Michael Cloney
- Department of Neurological Surgery, Northwestern University, Chicago, Illinois, USA
| | - Nader S Dahdaleh
- Department of Neurological Surgery, Northwestern University, Chicago, Illinois, USA
| | - Tyler R Koski
- Department of Neurological Surgery, Northwestern University, Chicago, Illinois, USA
| | - Najib E El Tecle
- Department of Neurological Surgery, Northwestern University, Chicago, Illinois, USA.
| |
Collapse
|
5
|
Gupta P, Kingston KA, O’Malley M, Williams RJ, Ramkumar PN. Advancements in Artificial Intelligence for Foot and Ankle Surgery: A Systematic Review. FOOT & ANKLE ORTHOPAEDICS 2023; 8:24730114221151079. [PMID: 36817020 PMCID: PMC9929923 DOI: 10.1177/24730114221151079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/16/2023] Open
Abstract
Background There has been a rapid increase in research applying artificial intelligence (AI) to various subspecialties of orthopaedic surgery, including foot and ankle surgery. The purpose of this systematic review is to (1) characterize the topics and objectives of studies using AI in foot and ankle surgery, (2) evaluate the performance of their models, and (3) evaluate their validity (internal or external validation). Methods A systematic literature review was conducted using PubMed/MEDLINE and Embase databases in December 2022. All studies that used AI or its subsets machine learning (ML) and deep learning (DL) in the setting of foot and ankle surgery relevant to orthopaedic surgeons were included. Studies were evaluated for their demographics, subject area, outcomes of interest, model(s) tested, model(s)' performance, and validity (internal or external). Results A total of 31 studies met inclusion criteria: 14 studies investigated AI for image interpretation, 13 studies investigated AI for clinical predictions, and 4 studies were grouped as "other." Studies commonly explored AI for ankle fractures, calcaneus fractures, hallux valgus, Achilles tendon pathologies, plantar fasciitis, and sports injuries. For studies reporting the area under the receiver operating characteristic curve (AUC), AUCs ranged from 0.64 (poor) to 0.99 (excellent). Two studies (6.45%) reported external validation. Conclusion Applications of AI in the field of foot and ankle surgery are expanding, particularly for image interpretation and clinical predictions. Current model performances range from poor to excellent, and most studies lack external validation, demonstrating a need for further research prior to deploying AI-based clinical applications. Level of Evidence Level III, retrospective cohort study.
Collapse
Affiliation(s)
- Puneet Gupta
- Department of Orthopaedic Surgery, George Washington University School of Medicine and Health Sciences, Washington, DC, USA
| | | | - Martin O’Malley
- Hospital for Special Surgery, New York, NY, USA,Brooklyn Nets, National Basketball Association (NBA), Brooklyn, NY, USA
| | - Riley J. Williams
- Hospital for Special Surgery, New York, NY, USA,Brooklyn Nets, National Basketball Association (NBA), Brooklyn, NY, USA
| | - Prem N. Ramkumar
- Hospital for Special Surgery, New York, NY, USA,Brooklyn Nets, National Basketball Association (NBA), Brooklyn, NY, USA,Prem N. Ramkumar, MD, MBA, Hospital for Special Surgery, 535 E 70th St, New York, NY 10021-4898, USA.
| |
Collapse
|
6
|
Machine learning predictive models for acute pancreatitis: A systematic review. Int J Med Inform 2021; 157:104641. [PMID: 34785488 DOI: 10.1016/j.ijmedinf.2021.104641] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Revised: 11/03/2021] [Accepted: 11/05/2021] [Indexed: 12/14/2022]
Abstract
INTRODUCTION Acute pancreatitis (AP) is a common clinical pancreatic disease. Patients with different severity levels have different clinical outcomes. With the advantages of algorithms, machine learning (ML) has gradually emerged in the field of disease prediction, assisting doctors in decision-making. METHODS A systematic review was conducted using the PubMed, Web of Science, Scopus, and Embase databases, following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Publication time was limited from inception to 29 May 2021. Studies that have used ML to establish predictive tools for AP were eligible for inclusion. Quality assessment of the included studies was conducted in accordance with the IJMEDI checklist. RESULTS In this systematic review, 24 of 2,913 articles, with a total of 8,327 patients and 47 models, were included. The studies could be divided into five categories: 10 studies (42%) reported severity prediction; 10 studies (42%), complication prediction; 3 studies (13%), mortality prediction; 2 studies (8%), recurrence prediction; and 2 studies (8%), surgery timing prediction. ML showed great accuracy in several prediction tasks. However, most of the included studies were retrospective in nature, conducted at a single centre, based on database data, and lacked external validation. According to the IJMEDI checklist and our scoring criteria, two studies were considered to be of high quality. Most studies had an obvious bias in the quality of data preparation, validation, and deployment dimensions. CONCLUSION In the prediction tasks for AP, ML has shown great potential in assisting decision-making. However, the existing studies still have some deficiencies in the process of model construction. Future studies need to optimize the deficiencies and further evaluate the comparability of the ML systems and model performance, so as to consequently develop high-quality ML-based models that can be used in clinical practice.
Collapse
|