1
|
Crijns TJ, Janssen SJ, Davis JT, Ring D, Sanchez HB, Amini MH, Appleton P, Babis GC, Babst RH, Ballas EG, Barquet A, Begue T, Bishop J, Borris LC, Buckley R, Chesser T, Choudhari P, Cornell C, Crist BD, DeCoster TA, Elias N, Frihagen F, Garnavos C, Giordano V, Haverlag R, Havlicek T, Hurwit S, Ibrahim EF, Iyer VM, Jenkinson R, Jeray K, Kabir K, Kanakaris NK, Klostermann C, Kreder HJ, Kreis B, Kristan A, Lygdas P, McGraw I, Mica L, Mirck B, Moreta-Suarez J, Morgan SJ, Nikolaou VS, Omara T, Pesantez R, Pirpiris M, Poelhekke L, Pountos I, Prayson M, Quell M, Rodríguez-Roiz JM, Satora W, Schandelmaier P, Schepers T, Short NL, Smith RM, Spoor A, Stojkovska Pemovska E, Swiontkowski M, Taitsman L, Tosounidis T, Tyllianakis M, Van bergen C, Van de Sande M, Van Helden S, Verbeek DO, Wascher DC, Weil Y. Reliability of the classification of proximal femur fractures: Does clinical experience matter? Injury 2018; 49:819-823. [PMID: 29549969 DOI: 10.1016/j.injury.2018.02.023] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/21/2018] [Accepted: 02/21/2018] [Indexed: 02/02/2023]
Abstract
BACKGROUND Radiographic fracture classification helps with research on prognosis and treatment. AO/OTA classification into fracture type has shown to be reliable, but further classification of fractures into subgroups reduces the interobserver agreement and takes a considerable amount of practice and experience in order to master. QUESTIONS/PURPOSES We assessed: (1) differences between more and less experienced trauma surgeons based on hip fractures treated per year, years of experience, and the percentage of their time dedicated to trauma, (2) differences in the interobserver agreement between classification into fracture type, group, and subgroup, and (3) differences in the interobserver agreement when assessing fracture stability compared to classifying fractures into type, group and subgroup. METHODS This study used the Science of Variation Group to measure factors associated with variation in interobserver agreement on classification of proximal femur fractures according to the AO/OTA classification on radiographs. We selected 30 anteroposterior radiographs from 1061 patients aged 55 years or older with an isolated fracture of the proximal femur, with a spectrum of fracture types proportional to the full database. To measure the interobserver agreement the Fleiss' kappa was determined and bootstrapping (resamples = 1000) was used to calculate the standard error, z statistic, and 95% confidence intervals. We compared the Kappa values of surgeons with more experience to less experienced surgeons. RESULTS There were no statistically significant differences in the Kappa values on each classification level (type, group, subgroup) between more and less experienced surgeons. When all surgeons were combined into one group, the interobserver reliability was the greatest for classifying the fractures into type (kappa, 0.90; 95% CI, 0.83 to 0.97; p < 0.001), reflecting almost perfect agreement. When comparing the kappa values between classes (type, group, subgroup), we found statistically significant differences between each class. Substantial agreement was found in the clinically relevant groups stable/unstable trochanteric, displaced/non-displaced femoral neck, and femoral head fractures (kappa, 0.60; 95% CI, 0.53 to 0.67, p < 0.001). CONCLUSIONS This study adds to a growing body of evidence that relatively simple distinctions are more reliable and that this is independent of surgeon experience.
Collapse
Affiliation(s)
- Tom J Crijns
- Department of Surgery and Perioperative Care, Dell Medical School, Health Discovery Building 6.706, 1701 Trinity St., Austin, TX 78723, USA.
| | - Stein J Janssen
- Department of General Surgery, OLVG, Oosterpark 9, 1091 AC Amsterdam, The Netherlands.
| | - Jacob T Davis
- Department of Orthopaedic Surgery, JPS Health Network, 1500 S. Main St, Fort Worth, TX 76104, USA.
| | - David Ring
- Department of Surgery and Perioperative Care, Dell Medical School, Health Discovery Building 6.706, 1701 Trinity St., Austin, TX 78723, USA.
| | - Hugo B Sanchez
- Department of Orthopaedic Surgery, Acclaim Physician Group, Ben Hogan Center, 800 5th Ave, Suite 400, Fort Worth, TX 76104, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
2
|
Claessen FMAP, Stoop N, Doornberg JN, Guitton TG, van den Bekerom MPJ, Ring D, Chauhan A, Wahegaonkar A, Shafritz A, Garcia G A, Miller A, Barquet A, Kristan A, Apard T, Armstrong A, Berner A, Jubel A, Kreis B, Babis C, Sutker B, Sears B, Nolan B, Crist B, Cross B, Wills B, Barreto C, Ekholm C, Swigart C, Oliveira Miranda C, Manke C, Zalavras C, Goldfarb C, Cassidy C, Walsh C, Jones C, Garnavos C, Young C, Moreno-Serrano C, Lomita C, Klostermann C, van Deurzen D, Rikli D, Polatsch D, Beingessner D, Drosdowech D, Eygendaal D, Patel M, Brilej D, Walbeehm E, Ballas E, Ibrahim E, Melamed E, Stojkovska Pemovska E, Hofmeister E, Hammerberg E, Kaplan F, Suarez F, Fernandes C, Lopez-Gonzalez F, Walter F, Frihagen F, Kraan G, Kontakis G, Dyer G, Kohut G, Panagopoulos G, Hernandez G, Porcellini G, Bayne G, Merrell G, DeSilva G, Della Rocca G, Bamberger H, Broekhuyse H, Durchholz H, Kodde I, McGraw I, Harris I, Pountos I, Wiater J, Choueka J, Kazanjian J, Gillespie J, Biert J, Fanuele J, Johnson J, Greenberg J, Abrams J, Hall J, Fischer J, Scheer J, Itamura J, Capo J, Braman J, Rubio J, Ortiz J, Filho J, Nolla J, Abboud J, Conflitti J, Abzug J, Patiño J, Rodríguez Roiz J, Adams J, Bishop J, Kabir K, Chivers K, Prommersberger K, Egol K, Rumball K, Dickson K, Jeray K, Poelhekke L, Campinhos L, Mica L, Borris L, Adolfsson L, Schulte L, Elmans L, Lane L, Paz L, Taitsman L, Guenter L, Austin L, Waseem M, Palmer M, Abdel-Ghany M, Richard M, Rizzo M, Pirpiris M, Di Micoli M, Bonczar M, Loebenberg M, Richardson M, Mormino M, Menon M, Soong M, Wood M, Meylaerts S, Darowish M, Nancollas M, Prayson M, Grafe M, Kessler M, Kaminaris M, Pirela-Cruz M, Mckee M, Merchant M, Tyllianakis M, Shafi M, Powell A, Shortt N, Felipe N, Parnes N, Bijlani N, Elias N, Akabudike N, Rossiter N, Lasanianos N, Kanakaris N, Brink O, van Eerten P, Paladini P, Martineau P, Appleton P, Levin P, Althausen P, Evans P, Jebson P, Krause P, Schandelmaier P, Peters A, Dantuluri P, Blazar P, Andreas P, Inna P, Quell M, Ramli R, de Bedout R, Ranade A, Ashish S, Smith R, Babst R, Omid R, Buckley R, Jenkinson R, Gilbert R, Page R, Papandrea R, Zura R, Gray R, Wagenmakers R, Pesantez R, van Riet R, Calfee R, van Helden S, Bouaicha S, Kakar S, Kaplan S, Scott F, Kaar S, Mitchell S, Rowinski S, Dodds S, Kennedy S, Beldner S, Schepers T, Guitton T, Gosens T, Baxamusa T, Taleb C, Tosounidis T, Wyrick T, Begue T, DeCoster T, Dienstknecht T, Varecka T, Mittlmeier T, Fischer T, Chesser T, Omara T, Bafus T, Siff T, Havlicek T, Sabesan V, Nikolaou V, Philippe V, Giordano V, Vochteloo A, Batson W, Hammert W, Satora W, Weil Y, Ruch D, Marsh L, Swiontkowski M, Hurwit S. Interpretation of Post-operative Distal Humerus Radiographs After Internal Fixation: Prediction of Later Loss of Fixation. J Hand Surg Am 2016; 41:e337-e341. [PMID: 27522299 DOI: 10.1016/j.jhsa.2016.07.094] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/30/2015] [Revised: 04/17/2016] [Accepted: 07/13/2016] [Indexed: 02/02/2023]
Abstract
PURPOSE Stable fixation of distal humerus fracture fragments is necessary for adequate healing and maintenance of reduction. The purpose of this study was to measure the reliability and accuracy of interpretation of postoperative radiographs to predict which implants will loosen or break after operative treatment of bicolumnar distal humerus fractures. We also addressed agreement among surgeons regarding which fracture fixation will loosen or break and the influence of years in independent practice, location of practice, and so forth. METHODS A total of 232 orthopedic residents and surgeons from around the world evaluated 24 anteroposterior and lateral radiographs of distal humerus fractures on a Web-based platform to predict which implants would loosen or break. Agreement among observers was measured using the multi-rater kappa measure. RESULTS The sensitivity of prediction of failure of fixation of distal humerus fracture on radiographs was 63%, specificity was 53%, positive predictive value was 36%, the negative predictive value was 78%, and accuracy was 56%. There was fair interobserver agreement (κ = 0.27) regarding predictions of failure of fixation of distal humerus fracture on radiographs. Interobserver variability did not change when assessed for the various subgroups. CONCLUSIONS When experienced and skilled surgeons perform fixation of type C distal humerus fracture, the immediate postoperative radiograph is not predictive of fixation failure. Reoperation based on the probability of failure might not be advisable. TYPE OF STUDY/LEVEL OF EVIDENCE Diagnostic III.
Collapse
Affiliation(s)
- Femke M A P Claessen
- Orthopaedic Hand and Upper Extremity Service, Harvard Medical School, Massachusetts General Hospital, Boston, MA
| | - Nicky Stoop
- Orthopaedic Hand and Upper Extremity Service, Harvard Medical School, Massachusetts General Hospital, Boston, MA
| | - Job N Doornberg
- Orthotrauma Research Center Amsterdam, University of Amsterdam Orthopaedic Residency Program, Amsterdam, The Netherlands
| | - Thierry G Guitton
- Orthotrauma Research Center Amsterdam, University of Amsterdam Orthopaedic Residency Program, Amsterdam, The Netherlands
| | | | - David Ring
- Orthopaedic Hand and Upper Extremity Service, Harvard Medical School, Massachusetts General Hospital, Boston, MA.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|