Do computed tomography and its 3D reconstruction increase the reproducibility of classifications of fractures of the proximal extremity of the humerus?

INTRA- AND INTER-OBSERVER AGREEMENT OF PROXIMAL HUMERAL FRACTURES CLASSIFICATIONS IN ADULTS

Objective

Evaluating intra- and inter-observer agreement of the Neer, AO, and AO/OTA proximal humerus fractures classification systems in adults.

Methods

In total, 100 X-rays of patients with proximal humerus fractures were selected according to the inclusion and exclusion criteria established in this study. They were evaluated by four evaluators with different levels of expertise. The evaluation was performed at two distinct moments, with an interval of 21 days between each analysis. Images were randomized for the second evaluation by a researcher who did not participate in the image selection process. A Fleiss Kappa test was performed to evaluate intra- and inter-observer agreement.

Results

We observed a substantial agreement with k = 0.669, k = 0.715, and k = 0.780 for the Neer, AO, and AO/OTA classification systems, respectively.

Conclusion

In the second evaluation, intra-observer agreement improved. In the first evaluation, we obtained values of k = 0.724, k = 0.490, and k = 0.599 for the evaluation of the Neer, AO, and AO/OTA classifications. In the second evaluation, the values k = 0.759, k = 0.772, and k = 0.858. Therefore, the evaluations went from moderate to substantial for the AO classification and from moderate to practically perfect for the AO/OTA classification. The level of inter-observer agreement was substantial (0.61-0.80), with k = 0.669, k = 0.715, and k = 0.780 for the Neer, AO, and AO/OTA classifications, respectively. Level of Evidence III, Cross-Sectional Observational Study.

The reliability of the Neer classification for proximal humerus fractures: A survey of orthopedic shoulder surgeons

Background

The Neer classification is among the most widely used systems to describe proximal humerus fractures (PHF) despite the poor interobserver agreement. The purpose of this study was to verify whether or not blinded shoulder surgeons and trainees agree with the authors of articles published in the highest impact-factor orthopedic journals.

Methods

All articles regarding PHF published between 2017 and 2019 in the top 10 orthopedic journals as rated by impact factor were searched. Articles were included if the authors used the Neer classification to describe at least 1 PHF in the figures. Figures were extracted without the legend, and X-rays ± computed tomography scan images were included when available. An international survey was conducted among 138 shoulder surgeons who were asked to record the Neer classification for each de-identified radiograph in the publications. The type of fracture mentioned in the legend of the published figure was considered as the gold standard.

Results

Survey participants agreed with the published article authors in 55% of cases overall (range 6%-96%, n = 35). The most common response disagreed with the article authors in 13 cases (37%), underestimating the number of parts in 11 of 13 cases. The interobserver agreement between the 138 responders was fair (k = 0.296). There was an association between the percentage of concordant answers and greater experience (number of years of shoulder surgery practice) of the responders (P = .0023). The number of parts, the number or type of available imaging modalities, and the geographic origin of participants did not influence the agreement between responders and authors.

Discussion

In more than one-third of cases, specialized shoulder surgeons disagree with article authors when interpreting the Neer classification of de-identified images of PHF in published manuscripts. Morphologic classification of PHF as the sole basis for treatment algorithms and surgical success should be scrutinized.

Interobserver and intraobserver agreement of three-dimensionally printed models for the classification of proximal humeral fractures

Hypothesis

This study aimed to examine whether three-dimensionally printed models (3D models) could improve interobserver and intraobserver agreement when classifying proximal humeral fractures (PHFs) using the Neer system. We hypothesized that 3D models would improve interobserver and intraobserver agreement compared with x-ray, two-dimensional (2D) and three-dimensional (3D) computed tomography (CT) and that agreement using 3D models would be higher for registrars than for consultants.

Methods

Thirty consecutive PHF images were selected from a state-wide database and classified by fourteen observers. Each imaging modality (x-ray, 2D CT, 3D CT, 3D models) was grouped and presented in a randomly allocated sequence on two separate occasions. Interobserver and intraobserver agreements were quantified with kappa values (κ), percentage agreement, and 95% confidence intervals (CIs).

Results

Seven orthopedic registrars and seven orthopedic consultants classified 30 fractures on one occasion (interobserver). Four registrars and three consultants additionally completed classification on a second occasion (intraobserver). Interobserver agreement was greater with 3D models than with x-ray (κ = 0.47, CI: 0.44-0.50, 66.5%, CI: 64.6-68.4% and κ = 0.29, CI: 0.26-0.31, 57.2%, CI: 55.1-59.3%, respectively), 2D CT (κ = 0.30, CI: 0.27-0.33, 57.8%, CI: 55.5-60.2%), and 3D CT (κ = 0.35, CI: 0.33-0.38, 58.8%, CI: 56.7-60.9%). Intraobserver agreement appeared higher for 3D models than for other modalities; however, results were not significant. There were no differences in interobserver or intraobserver agreement between registrars and consultants.

Conclusion

Three-dimensionally printed models improved interobserver agreement in the classification of PHFs using the Neer system. This has potential implications for using 3D models for surgical planning and teaching.

Imaging to improve agreement for proximal humeral fracture classification in adult patient: A systematic review of quantitative studies

Proximal humeral fracture classification has low reproducibility. Many studies have tried to increase inter- and intra-observer agreement with more sophisticated imaging. The aim of this review was to determine which imaging modality produces the best inter- and intra-observer agreement for proximal humeral fracture classification in adults and to determine if this varies with observer experience or fracture complexity. OvidMEDLINE, The Cochrane Library, EBSCO CINAHL and Elsevier Scopus were searched on July 22nd, 2018. Quantitative studies comparing at least two imaging modalities for inter- or intra-observer agreement of proximal humeral fracture classification in adults were eligible for inclusion in this systematic literature review. Two reviewers independently screened and extracted data. Study quality was appraised using a modified Downs and Black checklist. The search strategy identified 1987 studies, of which 15 met the eligibility criteria. All included studies addressed inter-observer agreement and 8 provided results for intra-observer agreement. A narrative synthesis was performed. Trends were compared between studies as clinical heterogeneity and the statistical measures used by included studies prevented meta-analysis. Inter- and intra-observer agreement was found to increase from radiographs (x-ray) to two-dimensional (2D) computed tomography (CT) to three-dimensional (3D) CT. 2D and 3D CT may improve inter-observer agreement to a greater extent in less experienced observers and in more complex fractures. Future studies should compare 2D and 3D CT with subgroups categorising surgeon experience and fracture complexity. X-ray should be used for initial assessment; however doctors should have a low threshold for ordering CT. PROSPERO number: CRD42018094307.

INTER/INTRA-OBSERVER EVALUATION BETWEEN RADIOGRAPHS AND TOMOGRAPHIES FOR PROXIMAL HUMERUS FRACTURE

OBJECTIVE

The use of images in 3D reconstruction is an instrument that facilitates the interpretation of the fracture, observations of deviations, rotations and articular surface.

OBJECTIVE

To evaluate the inter-observer and intra-observer reliability of the Neer x AO proximal humerus fracture classification on radiographs versus computed tomography with three-dimensional reconstruction (3D).

METHODS

We evaluated the digital radiographs (anteroposterior and profile) and computerized tomography with 3D reconstruction of patients presenting with a proximal humerus fracture, surgically treated at an Orthopedics and Traumatology Service. All radiographs and computed tomography were classified (Neer and AO) by eight (8) orthopedic surgeons, specialists in the upper limb and sent, following the pre-established numeration by the author, in a spreadsheet to the author of the study.

RESULTS

The Neer and AO scores were more reproducible when determined by computed tomography with 3D reconstruction, mainly in fractures of greater complexity (Neer 4 parts and AO group C). However, in absolute values, inter and intra-observer reproducibility and concordance still remain low.

CONCLUSION

Computed tomography with 3D reconstruction allows a better analysis of fractures of group C and Neer 4 parts. However, the inter and intra-observer agreement does not increase significantly in comparison to the radiographs. Level of evidence III, Study of non-consecutive patients, without gold standard, applied uniformly.

The trends and challenges in orthopaedic simulation

Generally, in some universities of medicine, orthopaedic training procedures represent a difficult task due to the inadequacies of the systems, the resources, and the use of technologies. This article explains the challenges and the needs for more research in the issue of orthopaedic simulation around the world.