1
|
Yoo HJ, Koo B, Yong CW, Lee KS. Prediction of gait recovery using machine learning algorithms in patients with spinal cord injury. Medicine (Baltimore) 2024; 103:e38286. [PMID: 38847729 PMCID: PMC11155515 DOI: 10.1097/md.0000000000038286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Accepted: 04/26/2024] [Indexed: 06/10/2024] Open
Abstract
With advances in artificial intelligence, machine learning (ML) has been widely applied to predict functional outcomes in clinical medicine. However, there has been no attempt to predict walking ability after spinal cord injury (SCI) based on ML. In this situation, the main purpose of this study was to predict gait recovery after SCI at discharge from an acute rehabilitation facility using various ML algorithms. In addition, we explored important variables that were related to the prognosis. Finally, we attempted to suggest an ML-based decision support system (DSS) for predicting gait recovery after SCI. Data were collected retrospectively from patients with SCI admitted to an acute rehabilitation facility between June 2008 to December 2021. Linear regression analysis and ML algorithms (random forest [RF], decision tree [DT], and support vector machine) were used to predict the functional ambulation category at the time of discharge (FAC_DC) in patients with traumatic or non-traumatic SCI (n = 353). The independent variables were age, sex, duration of acute care and rehabilitation, comorbidities, neurological information entered into the International Standards for Neurological Classification of SCI worksheet, and somatosensory-evoked potentials at the time of admission to the acute rehabilitation facility. In addition, the importance of variables and DT-based DSS for FAC_DC was analyzed. As a result, RF and DT accurately predicted the FAC_DC measured by the root mean squared error. The root mean squared error of RF and the DT were 1.09 and 1.24 for all participants, 1.20 and 1.06 for those with trauma, and 1.12 and 1.03 for those with non-trauma, respectively. In the analysis of important variables, the initial FAC was found to be the most influential factor in all groups. In addition, we could provide a simple DSS based on strong predictors such as the initial FAC, American Spinal Injury Association Impairment Scale grades, and neurological level of injury. In conclusion, we provide that ML can accurately predict gait recovery after SCI for the first time. By focusing on important variables and DSS, we can guide early prognosis and establish personalized rehabilitation strategies in acute rehabilitation hospitals.
Collapse
Affiliation(s)
- Hyun-Joon Yoo
- Korea University Research Institute for Medical Bigdata Science, Korea University College of Medicine, Seoul, Republic of Korea
| | - Bummo Koo
- School of Health and Environmental Science, Korea University College of Health Science, Seoul, Republic of Korea
| | - Chan-woo Yong
- School of Health and Environmental Science, Korea University College of Health Science, Seoul, Republic of Korea
| | - Kwang-Sig Lee
- AI Center, Korea University Anam Hospital, Korea University College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
2
|
Habibi MA, Naseri Alavi SA, Soltani Farsani A, Mousavi Nasab MM, Tajabadi Z, Kobets AJ. Predicting the Outcome and Survival of Patients with Spinal Cord Injury Using Machine Learning Algorithms: A Systematic Review. World Neurosurg 2024; 188:150-160. [PMID: 38796146 DOI: 10.1016/j.wneu.2024.05.103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Accepted: 05/16/2024] [Indexed: 05/28/2024]
Abstract
BACKGROUND Spinal cord injury (SCI) is a significant public health issue, leading to physical, psychological, and social complications. Machine learning (ML) algorithms have shown potential in diagnosing and predicting the functional and neurologic outcomes of subjects with SCI. ML algorithms can predict scores for SCI classification systems and accurately predict outcomes by analyzing large amounts of data. This systematic review aimed to examine the performance of ML algorithms for diagnosing and predicting the outcomes of subjects with SCI. METHODS The literature was comprehensively searched for the pertinent studies from inception to May 25, 2023. Therefore, electronic databases of PubMed, Embase, Scopus, and Web of Science were systematically searched with individual search syntax. RESULTS A total of 9424 individuals diagnosed with SCI across multiple studies were analyzed. Among the 21 studies included, 5 specifically aimed to evaluate diagnostic accuracy, while the remaining 16 focused on exploring prognostic factors or management strategies. CONCLUSIONS ML and deep learning (DL) have shown great potential in various aspects of SCI. ML and DL algorithms have been employed multiple times in predicting and diagnosing patients with SCI. While there are studies on diagnosing acute SCI using DL algorithms, further research is required in this area.
Collapse
Affiliation(s)
- Mohammad Amin Habibi
- Skull Base Research Center, Loghman Hakim Hospital, Shahid Beheshti University of Medical Sciences, Tehran, Iran; Clinical Research Development Center, Faculty of Medicine, Qom University of Medical Sciences, Qom, Iran
| | | | | | | | - Zohreh Tajabadi
- Digestive Disease Research Institute, Tehran University of Medical Sciences, Tehran, Iran
| | - Andrew J Kobets
- Department of Neurological Surgery, Montefiore Medical, Bronx, NY, USA
| |
Collapse
|
3
|
Maki S, Furuya T, Inoue T, Yunde A, Miura M, Shiratani Y, Nagashima Y, Maruyama J, Shiga Y, Inage K, Eguchi Y, Orita S, Ohtori S. Machine Learning Web Application for Predicting Functional Outcomes in Patients With Traumatic Spinal Cord Injury Following Inpatient Rehabilitation. J Neurotrauma 2024; 41:1089-1100. [PMID: 37917112 DOI: 10.1089/neu.2022.0383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2023] Open
Abstract
Accurately predicting functional outcomes in patients with spinal cord injury (SCI) helps clinicians set realistic functional recovery goals and improve the home environment after discharge. The present study aimed to develop and validate machine learning (ML) models to predict functional outcomes in patients with SCI and deploy the models within a web application. The study included data from the Japan Association of Rehabilitation Database from January 1, 1991, to December 31, 2015. Patients with SCI who were admitted to an SCI center or transferred to a participating post-acute rehabilitation hospital after receiving acute treatment were enrolled in this database. The primary outcome was functional ambulation at discharge from the rehabilitation hospital. The secondary outcome was the total motor Functional Independence Measure (FIM) score at discharge. We used binary classification models to predict whether functional ambulation was achieved, as well as regression models to predict total motor FIM scores at discharge. In the training dataset (70% random sample) using demographic characteristics and neurological and functional status as predictors, we built prediction performance matrices of multiple ML models and selected the best one for each outcome. We validated each model's predictive performance in the test dataset (the remaining 30%). Among the 4181 patients, 3827 were included in the prediction model for the total motor FIM score. The mean (standard deviation [SD]) age was 50.4 (18.7) years, and 3211 (83.9%) patients were male. There were 3122 patients included in the prediction model for functional ambulation. The CatBoost Classifier and regressor models showed the best performances in the training dataset. On the test dataset, the CatBoost Classifier had an area under the receiver operating characteristic curve of 0.8572 and an accuracy of 0.7769 for predicting functional ambulation. Likewise, the CatBoost Regressor performed well, with an R2 of 0.7859, a mean absolute error of 9.2957, and a root mean square error of 13.4846 for predicting the total motor FIM score. The final models were deployed in a web application to provide functional predictions. The application can be found at http://3.138.174.54:8501. In conclusion, our prediction models developed using ML successfully predicted functional outcomes in patients with SCI and were deployed in an open-access web application.
Collapse
Affiliation(s)
- Satoshi Maki
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
- Center for Frontier Medical Engineering, Chiba University, Chiba, Japan
| | - Takeo Furuya
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Takaki Inoue
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Atsushi Yunde
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Masataka Miura
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Yuki Shiratani
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Yuki Nagashima
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Juntaro Maruyama
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Yasuhiro Shiga
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Kazuhide Inage
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Yawara Eguchi
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Sumihisa Orita
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
- Center for Frontier Medical Engineering, Chiba University, Chiba, Japan
| | - Seiji Ohtori
- Department of Orthopedic Surgery, Graduate School of Medicine, Chiba University, Chiba, Japan
| |
Collapse
|
4
|
Chang MC, Kim JK, Park D, Kim JH, Kim CR, Choo YJ. The Use of Artificial Intelligence to Predict the Prognosis of Patients Undergoing Central Nervous System Rehabilitation: A Narrative Review. Healthcare (Basel) 2023; 11:2687. [PMID: 37830724 PMCID: PMC10572243 DOI: 10.3390/healthcare11192687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 09/27/2023] [Accepted: 09/30/2023] [Indexed: 10/14/2023] Open
Abstract
Applications of machine learning in the healthcare field have become increasingly diverse. In this review, we investigated the integration of artificial intelligence (AI) in predicting the prognosis of patients with central nervous system disorders such as stroke, traumatic brain injury, and spinal cord injury. AI algorithms have shown promise in prognostic assessment, but challenges remain in achieving a higher prediction accuracy for practical clinical use. We suggest that accumulating more diverse data, including medical imaging and collaborative efforts among hospitals, can enhance the predictive capabilities of AI. As healthcare professionals become more familiar with AI, its role in central nervous system rehabilitation is expected to advance significantly, revolutionizing patient care.
Collapse
Affiliation(s)
- Min Cheol Chang
- Department of Rehabilitation Medicine, College of Medicine, Yeungnam University, Daegu 42415, Republic of Korea;
| | - Jeoung Kun Kim
- Department of Business Administration, School of Business, Yeungnam University, Gyeongsan-si 38541, Republic of Korea;
| | - Donghwi Park
- Department of Rehabilitation Medicine, Daegu Fatima Hospital, Daegu 41199, Republic of Korea;
| | - Jang Hwan Kim
- Department of Rehabilitation Technology, Graduate School of Hanseo University, Seosan, Chungcheongnam-do 31962, Republic of Korea;
| | - Chung Reen Kim
- Department of Physical Medicine and Rehabilitation, Ulsan University Hospital, University of Ulsan College of Medicine, Ulsan 44033, Republic of Korea;
| | - Yoo Jin Choo
- Department of Rehabilitation Medicine, College of Medicine, Yeungnam University, Daegu 42415, Republic of Korea;
| |
Collapse
|
5
|
Dreizin D, Staziaki PV, Khatri GD, Beckmann NM, Feng Z, Liang Y, Delproposto ZS, Klug M, Spann JS, Sarkar N, Fu Y. Artificial intelligence CAD tools in trauma imaging: a scoping review from the American Society of Emergency Radiology (ASER) AI/ML Expert Panel. Emerg Radiol 2023; 30:251-265. [PMID: 36917287 PMCID: PMC10640925 DOI: 10.1007/s10140-023-02120-1] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Accepted: 02/27/2023] [Indexed: 03/16/2023]
Abstract
BACKGROUND AI/ML CAD tools can potentially improve outcomes in the high-stakes, high-volume model of trauma radiology. No prior scoping review has been undertaken to comprehensively assess tools in this subspecialty. PURPOSE To map the evolution and current state of trauma radiology CAD tools along key dimensions of technology readiness. METHODS Following a search of databases, abstract screening, and full-text document review, CAD tool maturity was charted using elements of data curation, performance validation, outcomes research, explainability, user acceptance, and funding patterns. Descriptive statistics were used to illustrate key trends. RESULTS A total of 4052 records were screened, and 233 full-text articles were selected for content analysis. Twenty-one papers described FDA-approved commercial tools, and 212 reported algorithm prototypes. Works ranged from foundational research to multi-reader multi-case trials with heterogeneous external data. Scalable convolutional neural network-based implementations increased steeply after 2016 and were used in all commercial products; however, options for explainability were narrow. Of FDA-approved tools, 9/10 performed detection tasks. Dataset sizes ranged from < 100 to > 500,000 patients, and commercialization coincided with public dataset availability. Cross-sectional torso datasets were uniformly small. Data curation methods with ground truth labeling by independent readers were uncommon. No papers assessed user acceptance, and no method included human-computer interaction. The USA and China had the highest research output and frequency of research funding. CONCLUSIONS Trauma imaging CAD tools are likely to improve patient care but are currently in an early stage of maturity, with few FDA-approved products for a limited number of uses. The scarcity of high-quality annotated data remains a major barrier.
Collapse
Affiliation(s)
- David Dreizin
- Department of Diagnostic Radiology and Nuclear Medicine, R Adams Cowley Shock Trauma Center, University of Maryland School of Medicine, Baltimore, MD, USA.
| | - Pedro V Staziaki
- Cardiothoracic Imaging, Department of Radiology, Larner College of Medicine, University of Vermont, Burlington, VT, USA
| | - Garvit D Khatri
- Department of Radiology, University of Washington School of Medicine, Seattle, WA, USA
| | - Nicholas M Beckmann
- Memorial Hermann Orthopedic & Spine Hospital, McGovern Medical School at UTHealth, Houston, TX, USA
| | - Zhaoyong Feng
- Epidemiology & Public Health, University of Maryland School of Medicine, Baltimore, MD, USA
| | - Yuanyuan Liang
- Epidemiology & Public Health, University of Maryland School of Medicine, Baltimore, MD, USA
| | - Zachary S Delproposto
- Division of Emergency Radiology, Department of Radiology, University of Michigan, Ann Arbor, MI, USA
| | | | - J Stephen Spann
- Department of Radiology, University of Alabama at Birmingham Heersink School of Medicine, Birmingham, AL, USA
| | - Nathan Sarkar
- University of Maryland School of Medicine, Baltimore, MD, USA
| | - Yunting Fu
- Health Sciences and Human Services Library, University of Maryland, Baltimore, Baltimore, MD, USA
| |
Collapse
|
6
|
Spinal Cord Injury AIS Predictions Using Machine Learning. eNeuro 2023; 10:ENEURO.0149-22.2022. [PMID: 36543536 PMCID: PMC9831144 DOI: 10.1523/eneuro.0149-22.2022] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Revised: 10/21/2022] [Accepted: 11/18/2022] [Indexed: 12/24/2022] Open
Abstract
The study used machine learning to predict The American Spinal Injury Association Impairment Scale (AIS) scores for newly injured spinal cord injury patients at hospital discharge time from hospital admission data. Additionally, machine learning was used to analyze the best model for feature importance to validate the criticality of the AIS score and highlight relevant demographic details. The data used for training machine learning models was from the National Spinal Cord Injury Statistical Center (NSCISC) database of U.S. spinal cord injury patient details. Eighteen real features were used from 417 provided features, which mapped to 53 machine learning features after processing. Eight models were tuned on the dataset to predict AIS scores, and Shapely analysis was performed to extract the most important of the 53 features. Patients within the NSCISC database who sustained injuries were between 1972 and 2016 after data cleaning (n = 20,790). Outcomes were test set multiclass accuracy and aggregated Shapely score magnitudes. Ridge Classifier was the best performer with 73.6% test set accuracy. AIS scores and neurologic category at the time of admission were the best predictors of recovery. Demographically, features were less important, but age, sex, marital status, and race stood out. AIS scores on admission are highly predictive of patient outcomes when combined with patient demographic data. Promising results in terms of predicting recovery were seen, and Shapely analysis allowed for the machine learning model to be probed as a whole, giving insight into overall feature trends.
Collapse
|
7
|
Dietz N, Vaitheesh Jaganathan, Alkin V, Mettille J, Boakye M, Drazin D. Machine learning in clinical diagnosis, prognostication, and management of acute traumatic spinal cord injury (SCI): A systematic review. J Clin Orthop Trauma 2022; 35:102046. [PMID: 36425281 PMCID: PMC9678757 DOI: 10.1016/j.jcot.2022.102046] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 08/23/2022] [Accepted: 10/18/2022] [Indexed: 11/19/2022] Open
Abstract
Background Machine learning has been applied to improve diagnosis and prognostication of acute traumatic spinal cord injury. We investigate potential for clinical integration of machine learning in this patient population to navigate variability in injury and recovery. Materials and methods We performed a systematic review using PRISMA guidelines through PubMed database to identify studies that use machine learning algorithms for clinical application toward improvements in diagnosis, management, and predictive modeling. Results Of the 132 records identified, a total of 13 articles met inclusion criteria and were included in final analysis. Of the 13 articles, 5 focused on diagnostic accuracy and 8 were related to prognostication or management of traumatic spinal cord injury. Across studies, 1983 patients with spinal cord injury were evaluated with most classifying as ASIA C or D. Retrospective designs were used in 10 of 13 studies and 3 were prospective. Studies focused on MRI evaluation and segmentation for diagnostic accuracy and prognostication, investigation of mean arterial pressure in acute care and intraoperative settings, prediction of ambulatory and functional ability, chronic complication prevention, and psychological quality of life assessments. Decision tree, random forests (RF), support vector machines (SVM), hierarchical cluster tree analysis (HCTA), artificial neural networks (ANN), convolutional neural networks (CNN) machine learning subtypes were used. Conclusions Machine learning represents a platform technology with clinical application in traumatic spinal cord injury diagnosis, prognostication, management, rehabilitation, and risk prevention of chronic complications and mental illness. SVM models showed improved accuracy when compared to other ML subtypes surveyed. Inherent variability across patients with SCI offers unique opportunity for ML and personalized medicine to drive desired outcomes and assess risks in this patient population.
Collapse
Affiliation(s)
- Nicholas Dietz
- Department of Neurosurgery, University of Louisville, 200 Abraham Flexner Hwy, Louisville, KY, 40202, USA
| | - Vaitheesh Jaganathan
- Department of Neurosurgery, University of Louisville, 200 Abraham Flexner Hwy, Louisville, KY, 40202, USA
| | | | - Jersey Mettille
- Department of Anesthesia, University of Louisville, Louisville, KY, USA
| | - Maxwell Boakye
- Department of Neurosurgery, University of Louisville, 200 Abraham Flexner Hwy, Louisville, KY, 40202, USA
| | - Doniel Drazin
- Department of Neurosurgery, Providence Regional Medical Center Everett, Everett, WA, USA
| |
Collapse
|