1
|
Dijkstra H, van de Kuit A, de Groot T, Canta O, Groot OQ, Oosterhoff JH, Doornberg JN. Systematic review of machine-learning models in orthopaedic trauma. Bone Jt Open 2024; 5:9-19. [PMID: 38226447 PMCID: PMC10790183 DOI: 10.1302/2633-1462.51.bjo-2023-0095.r1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/17/2024] Open
Abstract
Aims Machine-learning (ML) prediction models in orthopaedic trauma hold great promise in assisting clinicians in various tasks, such as personalized risk stratification. However, an overview of current applications and critical appraisal to peer-reviewed guidelines is lacking. The objectives of this study are to 1) provide an overview of current ML prediction models in orthopaedic trauma; 2) evaluate the completeness of reporting following the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement; and 3) assess the risk of bias following the Prediction model Risk Of Bias Assessment Tool (PROBAST) tool. Methods A systematic search screening 3,252 studies identified 45 ML-based prediction models in orthopaedic trauma up to January 2023. The TRIPOD statement assessed transparent reporting and the PROBAST tool the risk of bias. Results A total of 40 studies reported on training and internal validation; four studies performed both development and external validation, and one study performed only external validation. The most commonly reported outcomes were mortality (33%, 15/45) and length of hospital stay (9%, 4/45), and the majority of prediction models were developed in the hip fracture population (60%, 27/45). The overall median completeness for the TRIPOD statement was 62% (interquartile range 30 to 81%). The overall risk of bias in the PROBAST tool was low in 24% (11/45), high in 69% (31/45), and unclear in 7% (3/45) of the studies. High risk of bias was mainly due to analysis domain concerns including small datasets with low number of outcomes, complete-case analysis in case of missing data, and no reporting of performance measures. Conclusion The results of this study showed that despite a myriad of potential clinically useful applications, a substantial part of ML studies in orthopaedic trauma lack transparent reporting, and are at high risk of bias. These problems must be resolved by following established guidelines to instil confidence in ML models among patients and clinicians. Otherwise, there will remain a sizeable gap between the development of ML prediction models and their clinical application in our day-to-day orthopaedic trauma practice.
Collapse
Affiliation(s)
- Hidde Dijkstra
- Department of Orthopaedic Surgery, University Medical Centre Groningen, Groningen, Netherlands
- University Center for Geriatric Medicine, University of Groningen, University Medical Center Groningen, Groningen, Netherlands
| | - Anouk van de Kuit
- Department of Orthopaedic Surgery, University Medical Centre Groningen, Groningen, Netherlands
| | - Tom de Groot
- Department of Orthopaedic Surgery, University Medical Centre Groningen, Groningen, Netherlands
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Olga Canta
- Department of Orthopaedic Surgery, University Medical Centre Groningen, Groningen, Netherlands
| | - Olivier Q. Groot
- Department of Orthopaedic Surgery, University Medical Centre Utrecht, University of Utrecht, Utrecht, Netherlands
| | - Jacobien H. Oosterhoff
- Department of Engineering Systems & Services, Faculty Technology Policy and Management, Delft University of Technology, Delft, Netherlands
| | - Job N. Doornberg
- Department of Orthopaedic Surgery, University Medical Centre Groningen, Groningen, Netherlands
- Department of Orthopaedic Trauma Surgery, Flinders Medical Center, Flinders University, Adelaide, Australia
| | | |
Collapse
|
2
|
Tjardes T, Marche B, Imach S. Mangled extremity: limb salvage for reconstruction versus primary amputation. Curr Opin Crit Care 2023; 29:682-688. [PMID: 37909372 DOI: 10.1097/mcc.0000000000001108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2023]
Abstract
PURPOSE OF REVIEW While MESS has historically influenced limb salvage versus amputation decisions, its universal applicability remains uncertain. With trauma systems expanding and advancements in trauma care, the need for a nuanced understanding of limb salvage has become paramount. RECENT FINDINGS Recent literature reflects a shift in the management of mangled extremities. Vascular surgery, plastic surgery, and technological advancements have garnered attention. The MESS's efficacy in predicting amputation postvascular reconstruction has been questioned. Machine learning techniques have emerged as a means to predict peritraumatic amputation, incorporating a broader set of variables. Additionally, advancements in socket design, such as automated adjustments and bone-anchored prosthetics, show promise in enhancing prosthetic care. Surgical strategies to mitigate neuropathic pain, including targeted muscle reinnervation (TMR), are evolving and may offer relief for amputees. Predicting the long-term course of osteomyelitis following limb salvage is challenging, but it significantly influences patient quality of life. SUMMARY The review underscores the evolving landscape of limb salvage decision-making, emphasizing the need for personalized, patient-centered approaches. The Ganga Hospital Score (GHS) introduces a nuanced approach with a 'grey zone' for patients requiring individualized assessments. Future research may leverage artificial intelligence (AI) and predictive models to enhance decision support. Overall, the care of mangled extremities extends beyond a binary choice of limb salvage or amputation, necessitating a holistic understanding of patients' injury patterns, expectations, and abilities for optimal outcomes.
Collapse
Affiliation(s)
- Thorsten Tjardes
- Department of Trauma and Orthopedic Surgery, Cologne-Merheim Medical Center (CMMC), University of Witten/Herdecke, Cologne, Germany
| | | | | |
Collapse
|
3
|
Yao PF, Diao YD, McMullen EP, Manka M, Murphy J, Lin C. Predicting amputation using machine learning: A systematic review. PLoS One 2023; 18:e0293684. [PMID: 37934767 PMCID: PMC10629636 DOI: 10.1371/journal.pone.0293684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2023] [Accepted: 10/17/2023] [Indexed: 11/09/2023] Open
Abstract
Amputation is an irreversible, last-line treatment indicated for a multitude of medical problems. Delaying amputation in favor of limb-sparing treatment may lead to increased risk of morbidity and mortality. This systematic review aims to synthesize the literature on how ML is being applied to predict amputation as an outcome. OVID Embase, OVID Medline, ACM Digital Library, Scopus, Web of Science, and IEEE Xplore were searched from inception to March 5, 2023. 1376 studies were screened; 15 articles were included. In the diabetic population, models ranged from sub-optimal to excellent performance (AUC: 0.6-0.94). In trauma patients, models had strong to excellent performance (AUC: 0.88-0.95). In patients who received amputation secondary to other etiologies (e.g.: burns and peripheral vascular disease), models had similar performance (AUC: 0.81-1.0). Many studies were found to have a high PROBAST risk of bias, most often due to small sample sizes. In conclusion, multiple machine learning models have been successfully developed that have the potential to be superior to traditional modeling techniques and prospective clinical judgment in predicting amputation. Further research is needed to overcome the limitations of current studies and to bring applicability to a clinical setting.
Collapse
Affiliation(s)
- Patrick Fangping Yao
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada
| | - Yi David Diao
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada
| | - Eric P. McMullen
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada
| | - Marlin Manka
- Department of Computer Science, University of Western Ontario, London, ON, Canada
| | - Jessica Murphy
- Division of Physical Medicine and Rehabilitation, McMaster University, Hamilton, ON, Canada
| | - Celina Lin
- Division of Physical Medicine and Rehabilitation, McMaster University, Hamilton, ON, Canada
- Division of Physical Medicine and Rehabilitation, Hamilton Health Sciences, Hamilton, ON, Canada
| |
Collapse
|
4
|
Mabarak D, Behzadi F, Yang M, Wozniak A, Patel P, Aulivola B. Concomitant Orthopedic Injury is the Strongest Predictor of Amputation in Extremity Vascular Trauma. Ann Vasc Surg 2023; 91:161-167. [PMID: 36563845 PMCID: PMC10068617 DOI: 10.1016/j.avsg.2022.12.065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 11/30/2022] [Accepted: 12/02/2022] [Indexed: 12/24/2022]
Abstract
BACKGROUND Although the risk of extremity amputation related to an isolated vascular injury is low, it increases significantly with concomitant orthopedic injury. Our study aims to evaluate and quantify the impact of risk factors associated with trauma-related extremity amputation in patients with vascular injury. We sought to determine whether there are other potential predictors of amputation. METHODS A retrospective review of patients with extremity vascular injury presenting to a single level 1 academic trauma center between January 1, 2007, and December 31, 2018, was performed. All patients diagnosed with major vascular injury to the upper or lower extremity were included. Data on patient demographics, medical comorbidities, anatomic location of vascular injury, and the presence of soft tissue or orthopedic injury were collected. The main outcome measure was major amputation of the affected extremity. Major amputation included below-the-knee amputation, above-the-knee amputation, as well as any amputation of the upper extremity at or proximal to the wrist. RESULTS We identified 250 extremities with major vascular injury in 234 patients. Of these, 216 (86.4%) were male and 34 (13.6%) female. The mean age was 32.2 years (range 18-79 years) and mean follow-up was 6.9 (standard deviation: 3.3) years. Just over half of injuries, 130 (52.0%) involved the lower extremity. Forty extremities (29 lower and 11 upper), or 16.0%, of total injured extremities, required major amputation during the follow-up period. Concomitant orthopedic injury was present in 106 of 250 (42%) injured extremities. Using univariable logistic regression models, variables with a significant association with major amputation included older age, higher body mass index, blunt mechanism of injury, concomitant orthopedic injury, soft tissue injury, and nerve injury, and the need for fasciotomy (P < 0.05). In multivariable analyses, blunt mechanism of injury (odds ratio [OR] (confidence ratio {CI}): 6.51 (2.29, 18.46), P < 0.001) and concomitant orthopedic injury (OR [CI]: 7.23 [2.22, 23.55], P = 0.001) remained significant predictors of amputation. CONCLUSIONS Concomitant orthopedic injury and blunt mechanism in the setting of vascular injury are associated with a higher likelihood of amputation in patients with extremity vascular injury. Further development of a vascular extremity injury protocol may be needed to enhance limb salvage. Findings may guide patient discussion regarding limb-salvage decision-making.
Collapse
Affiliation(s)
| | | | - Maelee Yang
- Department of Plastic and Reconstructive Surgery, Loyola University Medical Center, Maywood, IL
| | | | - Purvi Patel
- Department of Trauma, Surgical Critical Care, and Burns, Loyola University Medical Center, Maywood, IL
| | - Bernadette Aulivola
- Department of Vascular Surgery and Endovascular Therapy, Loyola University Medical Center, Maywood, IL.
| |
Collapse
|
5
|
Management of the Mangled Extremity. CURRENT SURGERY REPORTS 2023. [DOI: 10.1007/s40137-023-00349-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/08/2023]
|
6
|
Wohlgemut JM, Kyrimi E, Stoner RS, Pisirir E, Marsh W, Perkins ZB, Tai NRM. The outcome of a prediction algorithm should be a true patient state rather than an available surrogate. J Vasc Surg 2021; 75:1495-1496. [PMID: 34921966 DOI: 10.1016/j.jvs.2021.10.059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Accepted: 10/30/2021] [Indexed: 10/19/2022]
Affiliation(s)
- Jared M Wohlgemut
- Centre for Trauma Sciences, Blizard Institute, Queen Mary University of London, London, United Kingdom; Royal London Hospital, Barts NHS Health Trust, London, United Kingdom
| | - Evangelia Kyrimi
- Department of Electrical Engineering and Computer Science, Queen Mary University of London, London, United Kingdom
| | - Rebecca S Stoner
- Centre for Trauma Sciences, Blizard Institute, Queen Mary University of London, London, United Kingdom; Royal London Hospital, Barts NHS Health Trust, London, United Kingdom
| | - Erhan Pisirir
- Department of Electrical Engineering and Computer Science, Queen Mary University of London, London, United Kingdom
| | - William Marsh
- Department of Electrical Engineering and Computer Science, Queen Mary University of London, London, United Kingdom
| | - Zane B Perkins
- Centre for Trauma Sciences, Blizard Institute, Queen Mary University of London, London, United Kingdom; Royal London Hospital, Barts NHS Health Trust, London, United Kingdom
| | - Nigel R M Tai
- Centre for Trauma Sciences, Blizard Institute, Queen Mary University of London, London, United Kingdom; Royal London Hospital, Barts NHS Health Trust, London, United Kingdom; Royal Centre for Defence Medicine, Birmingham, United Kingdom
| |
Collapse
|