1
|
Becker ER, Price AD, Barth J, Hong S, Chowdhry V, Starr AJ, Sagi HC, Park C, Goodman MD. External Validation of Predictors of Mortality in Polytrauma Patients. J Surg Res 2024; 301:618-622. [PMID: 39094520 DOI: 10.1016/j.jss.2024.07.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Revised: 05/04/2024] [Accepted: 07/03/2024] [Indexed: 08/04/2024]
Abstract
INTRODUCTION The Parkland Trauma Index of Mortality (PTIM) is an integrated, machine learning 72-h mortality prediction model that automatically extracts and analyzes demographic, laboratory, and physiological data in polytrauma patients. We hypothesized that this validated model would perform equally as well at another level 1 trauma center. METHODS A retrospective cohort study was performed including ∼5000 adult level 1 trauma activation patients from January 2022 to September 2023. Demographics, physiologic and laboratory values were collected. First, a test set of models using PTIM clinical variables (CVs) was used as external validation, named PTIM+. Then, multiple novel mortality prediction models were developed considering all CVs designated as the Cincinnati Trauma Index of Mortality (CTIM). The statistical performance of the models was then compared. RESULTS PTIM CVs were found to have similar predictive performance within the PTIM + external validation model. The highest correlating CVs used in CTIM overlapped considerably with those of the PTIM, and performance was comparable between models. Specifically, for prediction of mortality within 48 h (CTIM versus PTIM): positive prediction value was 35.6% versus 32.5%, negative prediction value was 99.6% versus 99.3%, sensitivity was 81.0% versus 82.5%, specificity was 97.3% versus 93.6%, and area under the curve was 0.98 versus 0.94. CONCLUSIONS This external cohort study suggests that the variables initially identified via PTIM retain their predictive ability and are accessible in a different level 1 trauma center. This work shows that a trauma center may be able to operationalize an effective predictive model without undertaking a repeated time and resource intensive process of full variable selection.
Collapse
Affiliation(s)
- Ellen R Becker
- Department of Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Adam D Price
- Department of Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Jackson Barth
- TraumaCare.AI, INC, Dallas, Texas; Department of Statistical Science, Baylor University, Waco, Texas
| | | | | | - Adam J Starr
- TraumaCare.AI, INC, Dallas, Texas; Department of Orthopedic Surgery, University of Texas Southwestern Medical Center, Dallas, Texas
| | - H Claude Sagi
- Department of Orthopaedic Surgery, University of Cincinnati, Cincinnati, Ohio
| | - Caroline Park
- TraumaCare.AI, INC, Dallas, Texas; Department of Surgery, University of Texas Southwestern Medical Center, Dallas, Texas
| | | |
Collapse
|
2
|
Butler Forslund E, Truong MTN, Wang R, Seiger Å, Gutierrez-Farewik EM. A Protocol for Comprehensive Analysis of Gait in Individuals with Incomplete Spinal Cord Injury. Methods Protoc 2024; 7:39. [PMID: 38804333 PMCID: PMC11130903 DOI: 10.3390/mps7030039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2024] [Revised: 04/17/2024] [Accepted: 04/29/2024] [Indexed: 05/29/2024] Open
Abstract
This is a protocol for comprehensive analysis of gait and affecting factors in individuals with incomplete paraplegia due to spinal cord injury (SCI). A SCI is a devastating event affecting both sensory and motor functions. Due to better care, the SCI population is changing, with a greater proportion retaining impaired ambulatory function. Optimizing ambulatory function after SCI remains challenging. To investigate factors influencing optimal ambulation, a multi-professional research project was grounded with expertise from clinical rehabilitation, neurophysiology, and biomechanical engineering from Karolinska Institutet, the Spinalis Unit at Aleris Rehab Station (Sweden's largest center for specialized neurorehabilitation), and the Promobilia MoveAbility Lab at KTH Royal Institute of Technology. Ambulatory adults with paraplegia will be consecutively invited to participate. Muscle strength, sensitivity, and spasticity will be assessed, and energy expenditure, 3D movements, and muscle function (EMG) during gait and submaximal contractions will be analyzed. Innovative computational modeling and data-driven analyses will be performed, including the identification of clusters of similar movement patterns among the heterogeneous population and analyses that study the link between complex sensorimotor function and movement performance. These results may help optimize ambulatory function for persons with SCI and decrease the risk of secondary conditions during gait with a life-long perspective.
Collapse
Affiliation(s)
- Emelie Butler Forslund
- Department of Neurobiology, Care Science and Society, Karolinska Institutet, 141 83 Stockholm, Sweden; (E.B.F.); (Å.S.)
- Aleris Rehab Station R&D Unit, 169 89 Solna, Sweden
| | - Minh Tat Nhat Truong
- KTH MoveAbility, Department of Engineering Mechanics, KTH Royal Institute of Technology, 100 44 Stockholm, Sweden; (M.T.N.T.); (R.W.)
| | - Ruoli Wang
- KTH MoveAbility, Department of Engineering Mechanics, KTH Royal Institute of Technology, 100 44 Stockholm, Sweden; (M.T.N.T.); (R.W.)
| | - Åke Seiger
- Department of Neurobiology, Care Science and Society, Karolinska Institutet, 141 83 Stockholm, Sweden; (E.B.F.); (Å.S.)
- Aleris Rehab Station R&D Unit, 169 89 Solna, Sweden
| | - Elena M. Gutierrez-Farewik
- KTH MoveAbility, Department of Engineering Mechanics, KTH Royal Institute of Technology, 100 44 Stockholm, Sweden; (M.T.N.T.); (R.W.)
- Department of Women’s and Children’s Health, Karolinska Institutet, 171 77 Stockholm, Sweden
| |
Collapse
|
3
|
Collazo C, Vargas I, Cara B, Weinheimer CJ, Grabau RP, Goldgof D, Hall L, Wickline SA, Pan H. Synergizing Deep Learning-Enabled Preprocessing and Human-AI Integration for Efficient Automatic Ground Truth Generation. Bioengineering (Basel) 2024; 11:434. [PMID: 38790302 PMCID: PMC11117745 DOI: 10.3390/bioengineering11050434] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2024] [Revised: 04/20/2024] [Accepted: 04/26/2024] [Indexed: 05/26/2024] Open
Abstract
The progress of incorporating deep learning in the field of medical image interpretation has been greatly hindered due to the tremendous cost and time associated with generating ground truth for supervised machine learning, alongside concerns about the inconsistent quality of images acquired. Active learning offers a potential solution to these problems of expanding dataset ground truth by algorithmically choosing the most informative samples for ground truth labeling. Still, this effort incurs the costs of human labeling, which needs minimization. Furthermore, automatic labeling approaches employing active learning often exhibit overfitting tendencies while selecting samples closely aligned with the training set distribution and excluding out-of-distribution samples, which could potentially improve the model's effectiveness. We propose that the majority of out-of-distribution instances can be attributed to inconsistent cross images. Since the FDA approved the first whole-slide image system for medical diagnosis in 2017, whole-slide images have provided enriched critical information to advance the field of automated histopathology. Here, we exemplify the benefits of a novel deep learning strategy that utilizes high-resolution whole-slide microscopic images. We quantitatively assess and visually highlight the inconsistencies within the whole-slide image dataset employed in this study. Accordingly, we introduce a deep learning-based preprocessing algorithm designed to normalize unknown samples to the training set distribution, effectively mitigating the overfitting issue. Consequently, our approach significantly increases the amount of automatic region-of-interest ground truth labeling on high-resolution whole-slide images using active deep learning. We accept 92% of the automatic labels generated for our unlabeled data cohort, expanding the labeled dataset by 845%. Additionally, we demonstrate expert time savings of 96% relative to manual expert ground-truth labeling.
Collapse
Affiliation(s)
| | - Ian Vargas
- The Heart Institute, College of Medicine, University of South Florida, Tampa, FL 33602, USA (B.C.); (S.A.W.)
| | - Brendon Cara
- The Heart Institute, College of Medicine, University of South Florida, Tampa, FL 33602, USA (B.C.); (S.A.W.)
| | - Carla J. Weinheimer
- Department of Medicine, Washington University in St. Louis, St. Louis, MO 63110, USA
| | - Ryan P. Grabau
- The Heart Institute, College of Medicine, University of South Florida, Tampa, FL 33602, USA (B.C.); (S.A.W.)
| | - Dmitry Goldgof
- College of Engineering, University of South Florida, Tampa, FL 33620, USA
| | - Lawrence Hall
- College of Engineering, University of South Florida, Tampa, FL 33620, USA
| | - Samuel A. Wickline
- The Heart Institute, College of Medicine, University of South Florida, Tampa, FL 33602, USA (B.C.); (S.A.W.)
| | - Hua Pan
- Department of Medicine, Washington University in St. Louis, St. Louis, MO 63110, USA
- Department of Pathology & Immunology, Washington University in St. Louis, St. Louis, MO 63110, USA
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO 63130, USA
| |
Collapse
|
4
|
Arjmandnia F, Alimohammadi E. The value of machine learning technology and artificial intelligence to enhance patient safety in spine surgery: a review. Patient Saf Surg 2024; 18:11. [PMID: 38528562 DOI: 10.1186/s13037-024-00393-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Accepted: 03/15/2024] [Indexed: 03/27/2024] Open
Abstract
Machine learning algorithms have the potential to significantly improve patient safety in spine surgeries by providing healthcare professionals with valuable insights and predictive analytics. These algorithms can analyze preoperative data, such as patient demographics, medical history, and imaging studies, to identify potential risk factors and predict postoperative complications. By leveraging machine learning, surgeons can make more informed decisions, personalize treatment plans, and optimize surgical techniques to minimize risks and enhance patient outcomes. Moreover, by harnessing the power of machine learning, healthcare providers can make data-driven decisions, personalize treatment plans, and optimize surgical interventions, ultimately enhancing the quality of care in spine surgery. The findings highlight the potential of integrating artificial intelligence in healthcare settings to mitigate risks and enhance patient safety in surgical practices. The integration of machine learning holds immense potential for enhancing patient safety in spine surgeries. By leveraging advanced algorithms and predictive analytics, healthcare providers can optimize surgical decision-making, mitigate risks, and personalize treatment strategies to improve outcomes and ensure the highest standard of care for patients undergoing spine procedures. As technology continues to evolve, the future of spine surgery lies in harnessing the power of machine learning to transform patient safety and revolutionize surgical practices. The present review article was designed to discuss the available literature in the field of machine learning techniques to enhance patient safety in spine surgery.
Collapse
Affiliation(s)
- Fatemeh Arjmandnia
- Department of Aneasthesiology, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Ehsan Alimohammadi
- Department of Neurosurgery, Kermanshah University of Medical Sciences, Imam Reza Hospital, Kermanshah, Iran.
| |
Collapse
|