Training improves interobserver reliability for the diagnosis of scaphoid fracture displacement

BACKGROUND

The diagnosis of displacement in scaphoid fractures is notorious for poor interobserver reliability.

QUESTIONS/PURPOSES

We tested whether training can improve interobserver reliability and sensitivity, specificity, and accuracy for the diagnosis of scaphoid fracture displacement on radiographs and CT scans.

METHODS

Sixty-four orthopaedic surgeons rated a set of radiographs and CT scans of 10 displaced and 10 nondisplaced scaphoid fractures for the presence of displacement, using a web-based rating application. Before rating, observers were randomized to a training group (34 observers) and a nontraining group (30 observers). The training group received an online training module before the rating session, and the nontraining group did not. Interobserver reliability for training and nontraining was assessed by Siegel's multirater kappa and the Z-test was used to test for significance.

RESULTS

There was a small, but significant difference in the interobserver reliability for displacement ratings in favor of the training group compared with the nontraining group. Ratings of radiographs and CT scans combined resulted in moderate agreement for both groups. The average sensitivity, specificity, and accuracy of diagnosing displacement of scaphoid fractures were, respectively, 83%, 85%, and 84% for the nontraining group and 87%, 86%, and 87% for the training group. Assuming a 5% prevalence of fracture displacement, the positive predictive value was 0.23 in the nontraining group and 0.25 in the training group. The negative predictive value was 0.99 in both groups.

CONCLUSIONS

Our results suggest training can improve interobserver reliability and sensitivity, specificity and accuracy for the diagnosis of scaphoid fracture displacement, but the improvements are slight. These findings are encouraging for future research regarding interobserver variation and how to reduce it further.

Which patient and surgeon characteristics are associated with surgeon experience of stress during an office visit?

Objective

To determine clinician and patient factors associated with the surgeon feelings of stress, futility, inadequacy, and frustration during an office visit.

Methods

A survey-based experiment presented clinical vignettes with randomized patient factors (such as symptom intensity, the number of prior consultations, and involvement in a legal dispute) and feeling behind schedule in order to determine which are most related to surgeon ratings of stress, futility, inadequacy, and frustration on 11-point Likert scales.

Results

Higher surgeon stress levels were independently associated with women patients, multiple prior consultations, a legal dispute, disproportionate symptom intensity, and being an hour behind in the office. The findings were similar for feelings of futility, inadequacy, and frustration.

Conclusion

Patient factors potentially indicative of mental and social health opportunities are associated with greater surgeon-rated stress and frustration.

Innovation

Trainings for surgeon self-awareness and effective communication can transform stressful or adversarial interactions into an effective part of helping patients get and stay healthy by diagnosing and addressing psychosocial aspects of the illness.

Level of evidence

N/a.