1
|
Johns WL, Martinazzi BJ, Miltenberg B, Nam HH, Hammoud S. ChatGPT Provides Unsatisfactory Responses to Frequently Asked Questions Regarding Anterior Cruciate Ligament Reconstruction. Arthroscopy 2024; 40:2067-2079.e1. [PMID: 38311261 DOI: 10.1016/j.arthro.2024.01.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Revised: 01/01/2024] [Accepted: 01/08/2024] [Indexed: 02/10/2024]
Abstract
PURPOSE To determine whether the free online artificial intelligence platform ChatGPT could accurately, adequately, and appropriately answer questions regarding anterior cruciate ligament (ACL) reconstruction surgery. METHODS A list of 10 questions about ACL surgery was created based on a review of frequently asked questions that appeared on websites of various orthopaedic institutions. Each question was separately entered into ChatGPT (version 3.5), and responses were recorded, scored, and graded independently by 3 authors. The reading level of the ChatGPT response was calculated using the WordCalc software package, and readability was assessed using the Flesch-Kincaid grade level, Simple Measure of Gobbledygook index, Coleman-Liau index, Gunning fog index, and automated readability index. RESULTS Of the 10 frequently asked questions entered into ChatGPT, 6 were deemed as unsatisfactory and requiring substantial clarification; 1, as adequate and requiring moderate clarification; 1, as adequate and requiring minor clarification; and 2, as satisfactory and requiring minimal clarification. The mean DISCERN score was 41 (inter-rater reliability, 0.721), indicating the responses to the questions were average. According to the readability assessments, a full understanding of the ChatGPT responses required 13.4 years of education, which corresponds to the reading level of a college sophomore. CONCLUSIONS Most of the ChatGPT-generated responses were outdated and failed to provide an adequate foundation for patients' understanding regarding their injury and treatment options. The reading level required to understand the responses was too advanced for some patients, leading to potential misunderstanding and misinterpretation of information. ChatGPT lacks the ability to differentiate and prioritize information that is presented to patients. CLINICAL RELEVANCE Recognizing the shortcomings in artificial intelligence platforms may equip surgeons to better set expectations and provide support for patients considering and preparing for ACL reconstruction.
Collapse
Affiliation(s)
- William L Johns
- Rothman Orthopaedic Institute, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, U.S.A
| | - Brandon J Martinazzi
- Rothman Orthopaedic Institute, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, U.S.A..
| | - Benjamin Miltenberg
- Rothman Orthopaedic Institute, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, U.S.A
| | - Hannah H Nam
- Penn State College of Medicine, Hershey, Pennsylvania, U.S.A
| | - Sommer Hammoud
- Rothman Orthopaedic Institute, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, U.S.A
| |
Collapse
|
2
|
Ton A, Wishart D, Ball JR, Shah I, Murakami K, Ordon MP, Alluri RK, Hah R, Safaee MM. The Evolution of Risk Assessment in Spine Surgery: A Narrative Review. World Neurosurg 2024; 188:1-14. [PMID: 38677646 DOI: 10.1016/j.wneu.2024.04.117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Revised: 04/17/2024] [Accepted: 04/18/2024] [Indexed: 04/29/2024]
Abstract
BACKGROUND Risk assessment is critically important in elective and high-risk interventions, particularly spine surgery. This narrative review describes the evolution of risk assessment from the earliest instruments focused on general surgical risk stratification, to more accurate and spine-specific risk calculators that quantified risk, to the current era of big data. METHODS The PubMed and SCOPUS databases were queried on October 11, 2023 using search terms to identify risk assessment tools (RATs) in spine surgery. A total of 108 manuscripts were included after screening with full-text review using the following inclusion criteria: 1) study population of adult spine surgical patients, 2) studies describing validation and subsequent performance of preoperative RATs, and 3) studies published in English. RESULTS Early RATs provided stratified patients into broad categories and allowed for improved communication between physicians. Subsequent risk calculators attempted to quantify risk by estimating general outcomes such as mortality, but then evolved to estimate spine-specific surgical complications. The integration of novel concepts such as invasiveness, frailty, genetic biomarkers, and sarcopenia led to the development of more sophisticated predictive models that estimate the risk of spine-specific complications and long-term outcomes. CONCLUSIONS RATs have undergone a transformative shift from generalized risk stratification to quantitative predictive models. The next generation of tools will likely involve integration of radiographic and genetic biomarkers, machine learning, and artificial intelligence to improve the accuracy of these models and better inform patients, surgeons, and payers.
Collapse
Affiliation(s)
- Andy Ton
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Danielle Wishart
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Jacob R Ball
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Ishan Shah
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Kiley Murakami
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Matthew P Ordon
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - R Kiran Alluri
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Raymond Hah
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Michael M Safaee
- Department of Neurological Surgery, Keck School of MedicineUniversity of Southern California, Los Angeles, California, USA.
| |
Collapse
|
3
|
Lin PC, Chang WS, Hsiao KY, Liu HM, Shia BC, Chen MC, Hsieh PY, Lai TW, Lin FH, Chang CC. Development of a Machine Learning Algorithm to Correlate Lumbar Disc Height on X-rays with Disc Bulging or Herniation. Diagnostics (Basel) 2024; 14:134. [PMID: 38248010 PMCID: PMC10814412 DOI: 10.3390/diagnostics14020134] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2023] [Revised: 12/28/2023] [Accepted: 01/02/2024] [Indexed: 01/23/2024] Open
Abstract
Lumbar disc bulging or herniation (LDBH) is one of the major causes of spinal stenosis and related nerve compression, and its severity is the major determinant for spine surgery. MRI of the spine is the most important diagnostic tool for evaluating the need for surgical intervention in patients with LDBH. However, MRI utilization is limited by its low accessibility. Spinal X-rays can rapidly provide information on the bony structure of the patient. Our study aimed to identify the factors associated with LDBH, including disc height, and establish a clinical diagnostic tool to support its diagnosis based on lumbar X-ray findings. In this study, a total of 458 patients were used for analysis and 13 clinical and imaging variables were collected. Five machine-learning (ML) methods, including LASSO regression, MARS, decision tree, random forest, and extreme gradient boosting, were applied and integrated to identify important variables for predicting LDBH from lumbar spine X-rays. The results showed L4-5 posterior disc height, age, and L1-2 anterior disc height to be the top predictors, and a decision tree algorithm was constructed to support clinical decision-making. Our study highlights the potential of ML-based decision tools for surgeons and emphasizes the importance of L1-2 disc height in relation to LDBH. Future research will expand on these findings to develop a more comprehensive decision-supporting model.
Collapse
Affiliation(s)
- Pao-Chun Lin
- Department of Biomedical Engineering, National Taiwan University, Taipei City 10617, Taiwan; (P.-C.L.); (F.-H.L.)
- Department of Neurosurgery, Fu Jen Catholic University Hospital, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| | - Wei-Shan Chang
- Graduate Institute of Business Administration, College of Management, Fu Jen Catholic University, New Taipei City 24352, Taiwan; (W.-S.C.); (K.-Y.H.); (B.-C.S.); (M.-C.C.)
- Artificial Intelligence Development Center, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| | - Kai-Yuan Hsiao
- Graduate Institute of Business Administration, College of Management, Fu Jen Catholic University, New Taipei City 24352, Taiwan; (W.-S.C.); (K.-Y.H.); (B.-C.S.); (M.-C.C.)
- Artificial Intelligence Development Center, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| | - Hon-Man Liu
- Department of Radiology, Fu Jen Catholic University Hospital, Fu Jen Catholic University, New Taipei City 24352, Taiwan;
| | - Ben-Chang Shia
- Graduate Institute of Business Administration, College of Management, Fu Jen Catholic University, New Taipei City 24352, Taiwan; (W.-S.C.); (K.-Y.H.); (B.-C.S.); (M.-C.C.)
- Artificial Intelligence Development Center, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| | - Ming-Chih Chen
- Graduate Institute of Business Administration, College of Management, Fu Jen Catholic University, New Taipei City 24352, Taiwan; (W.-S.C.); (K.-Y.H.); (B.-C.S.); (M.-C.C.)
- Artificial Intelligence Development Center, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| | - Po-Yu Hsieh
- Industrial Technology Research Institute (ITRI), Hsinchu City 310401, Taiwan; (P.-Y.H.); (T.-W.L.)
| | - Tseng-Wei Lai
- Industrial Technology Research Institute (ITRI), Hsinchu City 310401, Taiwan; (P.-Y.H.); (T.-W.L.)
| | - Feng-Huei Lin
- Department of Biomedical Engineering, National Taiwan University, Taipei City 10617, Taiwan; (P.-C.L.); (F.-H.L.)
| | - Che-Cheng Chang
- Department of Neurology, Fu Jen Catholic University Hospital, Fu Jen Catholic University, New Taipei City 24352, Taiwan
- PhD Program in Nutrition and Food Science, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| |
Collapse
|
4
|
Tragaris T, Benetos IS, Vlamis J, Pneumaticos S. Machine Learning Applications in Spine Surgery. Cureus 2023; 15:e48078. [PMID: 38046496 PMCID: PMC10689893 DOI: 10.7759/cureus.48078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/31/2023] [Indexed: 12/05/2023] Open
Abstract
This literature review sought to identify and evaluate the current applications of artificial intelligence (AI)/machine learning (ML) in spine surgery that can effectively guide clinical decision-making and surgical planning. By using specific keywords to maximize search sensitivity, a thorough literature research was conducted in several online databases: Scopus, PubMed, and Google Scholar, and the findings were filtered according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A total of 46 studies met the requirements and were included in this review. According to this study, AI/ML models were sufficiently accurate with a mean overall value of 74.9%, and performed best at preoperative patient selection, cost prediction, and length of stay. Performance was also good at predicting functional outcomes and postoperative mortality. Regression analysis was the most frequently utilized application whereas deep learning/artificial neural networks had the highest sensitivity score (81.5%). Despite the relatively brief history of engagement with AI/ML, as evidenced by the fact that 77.5% of studies were published after 2018, the outcomes have been promising. In light of the Big Data era, the increasing prevalence of National Registries, and the wide-ranging applications of AI, such as exemplified by ChatGPT (OpenAI, San Francisco, California), it is highly likely that the field of spine surgery will gradually adopt and integrate AI/ML into its clinical practices. Consequently, it is of great significance for spine surgeons to acquaint themselves with the fundamental principles of AI/ML, as these technologies hold the potential for substantial improvements in overall patient care.
Collapse
Affiliation(s)
- Themistoklis Tragaris
- 1st Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - Ioannis S Benetos
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - John Vlamis
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - Spyridon Pneumaticos
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| |
Collapse
|
5
|
Fayed AM, Mansur NSB, de Carvalho KA, Behrens A, D'Hooghe P, de Cesar Netto C. Artificial intelligence and ChatGPT in Orthopaedics and sports medicine. J Exp Orthop 2023; 10:74. [PMID: 37493985 PMCID: PMC10371934 DOI: 10.1186/s40634-023-00642-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 07/18/2023] [Indexed: 07/27/2023] Open
Abstract
Artificial intelligence (AI) is looked upon nowadays as the potential major catalyst for the fourth industrial revolution. In the last decade, AI use in Orthopaedics increased approximately tenfold. Artificial intelligence helps with tracking activities, evaluating diagnostic images, predicting injury risk, and several other uses. Chat Generated Pre-trained Transformer (ChatGPT), which is an AI-chatbot, represents an extremely controversial topic in the academic community. The aim of this review article is to simplify the concept of AI and study the extent of AI use in Orthopaedics and sports medicine literature. Additionally, the article will also evaluate the role of ChatGPT in scientific research and publications.Level of evidence: Level V, letter to review.
Collapse
Affiliation(s)
- Aly M Fayed
- Department of Orthopaedics and Rehabilitation, University of Iowa Hospitals and Clinics, Iowa City, IA, USA.
| | | | - Kepler Alencar de Carvalho
- Department of Orthopaedics and Rehabilitation, University of Iowa Hospitals and Clinics, Iowa City, IA, USA
| | - Andrew Behrens
- Department of Orthopaedics and Rehabilitation, University of Iowa Hospitals and Clinics, Iowa City, IA, USA
| | - Pieter D'Hooghe
- Aspetar Orthopedic and Sports Medicine Hospital, Doha, Qatar
| | | |
Collapse
|
6
|
Lopez CD, Boddapati V, Lombardi JM, Lee NJ, Mathew J, Danford NC, Iyer RR, Dyrszka MD, Sardar ZM, Lenke LG, Lehman RA. Artificial Learning and Machine Learning Applications in Spine Surgery: A Systematic Review. Global Spine J 2022; 12:1561-1572. [PMID: 35227128 PMCID: PMC9393994 DOI: 10.1177/21925682211049164] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
OBJECTIVES This current systematic review sought to identify and evaluate all current research-based spine surgery applications of AI/ML in optimizing preoperative patient selection, as well as predicting and managing postoperative outcomes and complications. METHODS A comprehensive search of publications was conducted through the EMBASE, Medline, and PubMed databases using relevant keywords to maximize the sensitivity of the search. No limits were placed on level of evidence or timing of the study. Findings were reported according to the PRISMA guidelines. RESULTS After application of inclusion and exclusion criteria, 41 studies were included in this review. Bayesian networks had the highest average AUC (.80), and neural networks had the best accuracy (83.0%), sensitivity (81.5%), and specificity (71.8%). Preoperative planning/cost prediction models (.89,82.2%) and discharge/length of stay models (.80,78.0%) each reported significantly higher average AUC and accuracy compared to readmissions/reoperation prediction models (.67,70.2%) (P < .001, P = .005, respectively). Model performance also significantly varied across postoperative management applications for average AUC and accuracy values (P < .001, P < .027, respectively). CONCLUSIONS Generally, authors of the reviewed studies concluded that AI/ML offers a potentially beneficial tool for providers to optimize patient care and improve cost-efficiency. More specifically, AI/ML models performed best, on average, when optimizing preoperative patient selection and planning and predicting costs, hospital discharge, and length of stay. However, models were not as accurate in predicting postoperative complications, adverse events, and readmissions and reoperations. An understanding of AI/ML-based applications is becoming increasingly important, particularly in spine surgery, as the volume of reported literature, technology accessibility, and clinical applications continue to rapidly expand.
Collapse
Affiliation(s)
- Cesar D. Lopez
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Venkat Boddapati
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA,Venkat Boddapati, MD, Columbia University Irving Medical Center, 622 W. 168th St., PH-11, New York, NY 10032, USA.
| | - Joseph M. Lombardi
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Nathan J. Lee
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Justin Mathew
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Nicholas C. Danford
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Rajiv R. Iyer
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Marc D. Dyrszka
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Zeeshan M. Sardar
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Lawrence G. Lenke
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| | - Ronald A. Lehman
- Department of Orthopaedic Surgery, The Spine Hospital, New York-Presbyterian/Columbia University Irving Medical Center, New York, NY, USA
| |
Collapse
|
7
|
D’Antoni F, Russo F, Ambrosio L, Bacco L, Vollero L, Vadalà G, Merone M, Papalia R, Denaro V. Artificial Intelligence and Computer Aided Diagnosis in Chronic Low Back Pain: A Systematic Review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19105971. [PMID: 35627508 PMCID: PMC9141006 DOI: 10.3390/ijerph19105971] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 05/09/2022] [Accepted: 05/12/2022] [Indexed: 12/10/2022]
Abstract
Low Back Pain (LBP) is currently the first cause of disability in the world, with a significant socioeconomic burden. Diagnosis and treatment of LBP often involve a multidisciplinary, individualized approach consisting of several outcome measures and imaging data along with emerging technologies. The increased amount of data generated in this process has led to the development of methods related to artificial intelligence (AI), and to computer-aided diagnosis (CAD) in particular, which aim to assist and improve the diagnosis and treatment of LBP. In this manuscript, we have systematically reviewed the available literature on the use of CAD in the diagnosis and treatment of chronic LBP. A systematic research of PubMed, Scopus, and Web of Science electronic databases was performed. The search strategy was set as the combinations of the following keywords: “Artificial Intelligence”, “Machine Learning”, “Deep Learning”, “Neural Network”, “Computer Aided Diagnosis”, “Low Back Pain”, “Lumbar”, “Intervertebral Disc Degeneration”, “Spine Surgery”, etc. The search returned a total of 1536 articles. After duplication removal and evaluation of the abstracts, 1386 were excluded, whereas 93 papers were excluded after full-text examination, taking the number of eligible articles to 57. The main applications of CAD in LBP included classification and regression. Classification is used to identify or categorize a disease, whereas regression is used to produce a numerical output as a quantitative evaluation of some measure. The best performing systems were developed to diagnose degenerative changes of the spine from imaging data, with average accuracy rates >80%. However, notable outcomes were also reported for CAD tools executing different tasks including analysis of clinical, biomechanical, electrophysiological, and functional imaging data. Further studies are needed to better define the role of CAD in LBP care.
Collapse
Affiliation(s)
- Federico D’Antoni
- Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 21, 00128 Rome, Italy; (F.D.); (L.B.); (L.V.)
| | - Fabrizio Russo
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
- Correspondence: (F.R.); (M.M.)
| | - Luca Ambrosio
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| | - Luca Bacco
- Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 21, 00128 Rome, Italy; (F.D.); (L.B.); (L.V.)
- ItaliaNLP Lab, Istituto di Linguistica Computazionale “Antonio Zampolli”, National Research Council, Via Giuseppe Moruzzi, 1, 56124 Pisa, Italy
- Webmonks S.r.l., Via del Triopio, 5, 00178 Rome, Italy
| | - Luca Vollero
- Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 21, 00128 Rome, Italy; (F.D.); (L.B.); (L.V.)
| | - Gianluca Vadalà
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| | - Mario Merone
- Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 21, 00128 Rome, Italy; (F.D.); (L.B.); (L.V.)
- Correspondence: (F.R.); (M.M.)
| | - Rocco Papalia
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| | - Vincenzo Denaro
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| |
Collapse
|
8
|
Colombo T, Mangone M, Agostini F, Bernetti A, Paoloni M, Santilli V, Palagi L. Supervised and unsupervised learning to classify scoliosis and healthy subjects based on non-invasive rasterstereography analysis. PLoS One 2021; 16:e0261511. [PMID: 34941924 PMCID: PMC8699618 DOI: 10.1371/journal.pone.0261511] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Accepted: 12/05/2021] [Indexed: 11/18/2022] Open
Abstract
The aim of our study was to classify scoliosis compared to to healthy patients using non-invasive surface acquisition via Video-raster-stereography, without prior knowledge of radiographic data. Data acquisitions were made using Rasterstereography; unsupervised learning was adopted for clustering and supervised learning was used for prediction model Support Vector Machine and Deep Network architectures were compared. A M-fold cross validation procedure was performed to evaluate the results. The accuracy and balanced accuracy of the best supervised model were close to 85%. Classification rates by class were measured using the confusion matrix, giving a low percentage of unclassified patients. Rasterstereography has turned out to be a good tool to distinguish subject with scoliosis from healthy patients limiting the exposure to unnecessary radiations.
Collapse
Affiliation(s)
- Tommaso Colombo
- Department of Computer, Control and Management Engineering Antonio Ruberti, Sapienza University of Rome, Rome, Italy
- aHead Research ETS, Rome, Italy
| | - Massimiliano Mangone
- Department of Anatomical and Histological Sciences, Legal Medicine and Orthopedics, Sapienza University of Rome, Rome, Italy
| | - Francesco Agostini
- Department of Anatomical and Histological Sciences, Legal Medicine and Orthopedics, Sapienza University of Rome, Rome, Italy
| | - Andrea Bernetti
- Department of Anatomical and Histological Sciences, Legal Medicine and Orthopedics, Sapienza University of Rome, Rome, Italy
| | - Marco Paoloni
- Department of Anatomical and Histological Sciences, Legal Medicine and Orthopedics, Sapienza University of Rome, Rome, Italy
| | - Valter Santilli
- Department of Anatomical and Histological Sciences, Legal Medicine and Orthopedics, Sapienza University of Rome, Rome, Italy
| | - Laura Palagi
- Department of Computer, Control and Management Engineering Antonio Ruberti, Sapienza University of Rome, Rome, Italy
| |
Collapse
|
9
|
D’Antoni F, Russo F, Ambrosio L, Vollero L, Vadalà G, Merone M, Papalia R, Denaro V. Artificial Intelligence and Computer Vision in Low Back Pain: A Systematic Review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph182010909. [PMID: 34682647 PMCID: PMC8535895 DOI: 10.3390/ijerph182010909] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Revised: 10/04/2021] [Accepted: 10/09/2021] [Indexed: 12/16/2022]
Abstract
Chronic Low Back Pain (LBP) is a symptom that may be caused by several diseases, and it is currently the leading cause of disability worldwide. The increased amount of digital images in orthopaedics has led to the development of methods related to artificial intelligence, and to computer vision in particular, which aim to improve diagnosis and treatment of LBP. In this manuscript, we have systematically reviewed the available literature on the use of computer vision in the diagnosis and treatment of LBP. A systematic research of PubMed electronic database was performed. The search strategy was set as the combinations of the following keywords: "Artificial Intelligence", "Feature Extraction", "Segmentation", "Computer Vision", "Machine Learning", "Deep Learning", "Neural Network", "Low Back Pain", "Lumbar". Results: The search returned a total of 558 articles. After careful evaluation of the abstracts, 358 were excluded, whereas 124 papers were excluded after full-text examination, taking the number of eligible articles to 76. The main applications of computer vision in LBP include feature extraction and segmentation, which are usually followed by further tasks. Most recent methods use deep learning models rather than digital image processing techniques. The best performing methods for segmentation of vertebrae, intervertebral discs, spinal canal and lumbar muscles achieve Sørensen-Dice scores greater than 90%, whereas studies focusing on localization and identification of structures collectively showed an accuracy greater than 80%. Future advances in artificial intelligence are expected to increase systems' autonomy and reliability, thus providing even more effective tools for the diagnosis and treatment of LBP.
Collapse
Affiliation(s)
- Federico D’Antoni
- Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo 21, 00128 Rome, Italy; (F.D.); (L.V.)
| | - Fabrizio Russo
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
- Correspondence: (F.R.); (M.M.)
| | - Luca Ambrosio
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| | - Luca Vollero
- Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo 21, 00128 Rome, Italy; (F.D.); (L.V.)
| | - Gianluca Vadalà
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| | - Mario Merone
- Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo 21, 00128 Rome, Italy; (F.D.); (L.V.)
- Correspondence: (F.R.); (M.M.)
| | - Rocco Papalia
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| | - Vincenzo Denaro
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| |
Collapse
|
10
|
Chen K, Zhai X, Sun K, Wang H, Yang C, Li M. A narrative review of machine learning as promising revolution in clinical practice of scoliosis. ANNALS OF TRANSLATIONAL MEDICINE 2021; 9:67. [PMID: 33553360 PMCID: PMC7859734 DOI: 10.21037/atm-20-5495] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Machine learning (ML), as an advanced domain of artificial intelligence (AI), is progressively changing our view of the world. By implementing its algorithms, our ability to detect previously undiscoverable patterns in data has the potential to revolutionize predictive analytics. Scoliosis, as a relatively specialized branch in the spine field, mainly covers the pediatric, adult and the elderly populations, and its diagnosis and treatment remain difficult. With recent efforts and interdisciplinary cooperation, ML has been widely applied to investigate issues related to scoliosis, and surprisingly augment a surgeon's ability in clinical practice related to scoliosis. Meanwhile, ML models penetrate in every stage of the clinical practice procedure of scoliosis. In this review, we first present a brief description of the application of ML in the clinical practice procedures regarding scoliosis, including screening, diagnosis and classification, surgical decision making, intraoperative manipulation, complication prediction, prognosis prediction and rehabilitation. Meanwhile, the ML models and specific applications adopted are presented. Additionally, current limitations and future directions are briefly discussed regarding its use in the field of scoliosis. We believe that the implementation of ML is a promising revolution to assist surgeons in all aspects of clinical practice related to scoliosis in the near future.
Collapse
Affiliation(s)
- Kai Chen
- Department of Orthopedics, Shanghai Changhai Hospital, Shanghai, China
| | - Xiao Zhai
- Department of Orthopedics, Shanghai Changhai Hospital, Shanghai, China
| | - Kaiqiang Sun
- Department of Orthopedics, Shanghai Changzheng Hospital, Shanghai, China
| | - Haojue Wang
- Basic medicine college, Navy Medical University, Shanghai, China
| | - Changwei Yang
- Department of Orthopedics, Shanghai Changhai Hospital, Shanghai, China
| | - Ming Li
- Department of Orthopedics, Shanghai Changhai Hospital, Shanghai, China
| |
Collapse
|
11
|
Cabitza F, Locoro A, Banfi G. Machine Learning in Orthopedics: A Literature Review. Front Bioeng Biotechnol 2018; 6:75. [PMID: 29998104 PMCID: PMC6030383 DOI: 10.3389/fbioe.2018.00075] [Citation(s) in RCA: 109] [Impact Index Per Article: 18.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2018] [Accepted: 05/23/2018] [Indexed: 12/12/2022] Open
Abstract
In this paper we present the findings of a systematic literature review covering the articles published in the last two decades in which the authors described the application of a machine learning technique and method to an orthopedic problem or purpose. By searching both in the Scopus and Medline databases, we retrieved, screened and analyzed the content of 70 journal articles, and coded these resources following an iterative method within a Grounded Theory approach. We report the survey findings by outlining the articles' content in terms of the main machine learning techniques mentioned therein, the orthopedic application domains, the source data and the quality of their predictive performance.
Collapse
Affiliation(s)
- Federico Cabitza
- Dipartimento di Informatica, Sistemistica e Comunicazione, Universitá degli Studi di Milano-Bicocca, Milan, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | | | - Giuseppe Banfi
- Dipartimento di Informatica, Sistemistica e Comunicazione, Universitá degli Studi di Milano-Bicocca, Milan, Italy
| |
Collapse
|
12
|
Predicting success or failure of brace treatment for adolescents with idiopathic scoliosis. Med Biol Eng Comput 2015; 53:1001-9. [PMID: 26002592 DOI: 10.1007/s11517-015-1306-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2013] [Accepted: 05/04/2015] [Indexed: 10/23/2022]
Abstract
Adolescent idiopathic scoliosis (AIS) is a three-dimensional spinal deformity. Brace treatment is a common non-surgical treatment, intended to prevent progression (worsening) of the condition during adolescence. Estimating a braced patient's risk of progression is an essential part of planning treatment, so method for predicting this risk would be a useful decision support tool for practitioners. This work attempts to discover whether failure of brace treatment (progression) can be predicted at the start of treatment. Records were obtained for 62 AIS patients who had completed brace treatment. Subjects were labeled as "progressive" if their condition had progressed despite brace treatment and "non-progressive" otherwise. Wrapper-based feature selection selected two useful predictor variables from a list of 14 clinical measurements taken from the records. A logistic regression model was trained to classify patients as "progressive" or "non-progressive" using these two variables. The logistic regression model's simplicity and interpretability should facilitate its clinical acceptance. The model was tested on data from an additional 28 patients and found to be 75 % accurate. This accuracy is sufficient to make the predictions clinically useful. It can be used online: http://www.ece.ualberta.ca/~dchalmer/SimpleBracePredictor.html .
Collapse
|
13
|
Poredoš P, Čelan D, Možina J, Jezeršek M. Determination of the human spine curve based on laser triangulation. BMC Med Imaging 2015; 15:2. [PMID: 25651841 PMCID: PMC4327951 DOI: 10.1186/s12880-015-0044-5] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2014] [Accepted: 01/21/2015] [Indexed: 12/04/2022] Open
Abstract
Background The main objective of the present method was to automatically obtain a spatial curve of the thoracic and lumbar spine based on a 3D shape measurement of a human torso with developed scoliosis. Manual determination of the spine curve, which was based on palpation of the thoracic and lumbar spinous processes, was found to be an appropriate way to validate the method. Therefore a new, noninvasive, optical 3D method for human torso evaluation in medical practice is introduced. Methods Twenty-four patients with confirmed clinical diagnosis of scoliosis were scanned using a specially developed 3D laser profilometer. The measuring principle of the system is based on laser triangulation with one-laser-plane illumination. The measurement took approximately 10 seconds at 700 mm of the longitudinal translation along the back. The single point measurement accuracy was 0.1 mm. Computer analysis of the measured surface returned two 3D curves. The first curve was determined by manual marking (manual curve), and the second was determined by detecting surface curvature extremes (automatic curve). The manual and automatic curve comparison was given as the root mean square deviation (RMSD) for each patient. The intra-operator study involved assessing 20 successive measurements of the same person, and the inter-operator study involved assessing measurements from 8 operators. Results The results obtained for the 24 patients showed that the typical RMSD between the manual and automatic curve was 5.0 mm in the frontal plane and 1.0 mm in the sagittal plane, which is a good result compared with palpatory accuracy (9.8 mm). The intra-operator repeatability of the presented method in the frontal and sagittal planes was 0.45 mm and 0.06 mm, respectively. The inter-operator repeatability assessment shows that that the presented method is invariant to the operator of the computer program with the presented method. Conclusions The main novelty of the presented paper is the development of a new, non-contact method that provides a quick, precise and non-invasive way to determine the spatial spine curve for patients with developed scoliosis and the validation of the presented method using the palpation of the spinous processes, where no harmful ionizing radiation is present.
Collapse
Affiliation(s)
- Primož Poredoš
- University of Ljubljana, Faculty of Mechanical Engineering, Aškerčeva 6, 1000, Ljubljana, Slovenia.
| | - Dušan Čelan
- University Medical Centre Maribor, Ljubljanska ulica 5, 2000, Maribor, Slovenia.
| | - Janez Možina
- University of Ljubljana, Faculty of Mechanical Engineering, Aškerčeva 6, 1000, Ljubljana, Slovenia.
| | - Matija Jezeršek
- University of Ljubljana, Faculty of Mechanical Engineering, Aškerčeva 6, 1000, Ljubljana, Slovenia.
| |
Collapse
|