Three Observations for Improving Efforts in Surgical Quality Improvement

Structured feedback and operative video debriefing with critical view of safety annotation in training of laparoscopic cholecystectomy: a randomized controlled study

BACKGROUND

The learning curve in minimally invasive surgery (MIS) is lengthened compared to open surgery. It has been reported that structured feedback and training in teams of two trainees improves MIS training and MIS performance. Annotation of surgical images and videos may prove beneficial for surgical training. This study investigated whether structured feedback and video debriefing, including annotation of critical view of safety (CVS), have beneficial learning effects in a predefined, multi-modal MIS training curriculum in teams of two trainees.

METHODS

This randomized-controlled single-center study included medical students without MIS experience (n = 80). The participants first completed a standardized and structured multi-modal MIS training curriculum. They were then randomly divided into two groups (n = 40 each), and four laparoscopic cholecystectomies (LCs) were performed on ex-vivo porcine livers each. Students in the intervention group received structured feedback after each LC, consisting of LC performance evaluations through tutor-trainee joint video debriefing and CVS video annotation. Performance was evaluated using global and LC-specific Objective Structured Assessments of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Skills (GOALS) scores.

RESULTS

The participants in the intervention group had higher global and LC-specific OSATS as well as global and LC-specific GOALS scores than the participants in the control group (25.5 ± 7.3 vs. 23.4 ± 5.1, p = 0.003; 47.6 ± 12.9 vs. 36 ± 12.8, p < 0.001; 17.5 ± 4.4 vs. 16 ± 3.8, p < 0.001; 6.6 ± 2.3 vs. 5.9 ± 2.1, p = 0.005). The intervention group achieved CVS more often than the control group (1. LC: 20 vs. 10 participants, p = 0.037, 2. LC: 24 vs. 8, p = 0.001, 3. LC: 31 vs. 8, p < 0.001, 4. LC: 31 vs. 10, p < 0.001).

CONCLUSIONS

Structured feedback and video debriefing with CVS annotation improves CVS achievement and ex-vivo porcine LC training performance based on OSATS and GOALS scores.

Daily handover in surgery: systematic review and a novel taxonomy of interventions and outcomes

BACKGROUND

Poor-quality handovers lead to adverse outcomes for patients; however, there is a lack of evidence to support safe surgical handovers. This systematic review aims to summarize the interventions available to improve end-of-shift surgical handover. A novel taxonomy of interventions and outcomes and a modified quality assessment tool are also described.

METHODS

Ovid MEDLINE®, PubMed, Embase, and Cochrane databases were searched for articles up to April 2023. Comparative studies describing interventions for daily in-hospital surgical handovers between doctors were included. Studies were grouped according to their interventions and outcomes.

RESULTS

In total, 6139 citations were retrieved, and 41 studies met the inclusion criteria. The total patient sample sizes in the control and intervention groups were 11 946 and 11 563 patients, respectively. Most studies were pre-/post-intervention cohort studies (92.7%), and most (73.2%) represented level V evidence. The mean quality assessment score was 53.4% (17.1). A taxonomy of handover interventions and outcomes was developed, with interventions including handover tools, process standardization measures, staff education, and the use of mnemonics. More than 25% of studies used a document as the only intervention. Overall, 55 discrete outcomes were assessed in four categories including process (n = 27), staff (n = 14), patient (n = 12) and system-level (n = 2) outcomes. Significant improvements were seen in 51.8%, 78.5%, 58.3% (n = 9761 versus 9312 patients) and 100% of these outcomes, respectively.

CONCLUSIONS

Most publications demonstrate that good-quality surgical handover improves outcomes and many interventions appear to be effective; however, studies are methodologically heterogeneous. These novel taxonomies and quality assessment tool will help standardize future studies.

Composite quality measures of abdominal surgery at a population level: systematic review

BACKGROUND

Measurement of surgical quality at a population level is challenging. Composite quality measures derived from administrative and clinical information systems could support system-wide surgical quality improvement by providing a simple metric that can be evaluated over time. The aim of this systematic review was to identify published studies of composite measures used to assess the overall quality of abdominal surgical services at a hospital or population level.

METHODS

A search was conducted in PubMed and MEDLINE for references describing measurement instruments evaluating the overall quality of abdominal surgery. Instruments combining multiple process and quality indicators into a single composite quality score were included. The identified instruments were described in terms of transparency, justification, handling of missing data, case-mix adjustment, scale branding and choice of weight and uncertainty to assess their relative strengths and weaknesses (PROSPERO registration: CRD42022345074).

RESULTS

Of 5234 manuscripts screened, 13 were included. Ten unique composite quality measures were identified, mostly developed within the past decade. Outcome measures such as mortality rate (40 per cent), length of stay (40 per cent), complication rate (60 per cent) and morbidity rate (70 per cent) were consistently included. A major challenge for all instruments is the reliance of valid administrative data and the challenges of assigning appropriate weights to the underlying instrument components. A conceptual framework for composite measures of surgical quality was developed.

CONCLUSION

None of the composite quality measures identified demonstrated marked superiority over others. The degree to which administrative and clinical data influences each composite measure differs in important ways. There is a need for further testing and development of these measures.

Discordance in Total Mesorectal Excision Specimen Grading in a Prospective Phase 2 Multicenter Rectal Cancer Trial: Are We Overestimating the Quality of Our Resections?

OBJECTIVES

To report the results of a rigorous quality control (QC) process in the grading of total mesorectal excision (TME) specimens during a multicenter prospective phase 2 trial of transanal TME.

BACKGROUND

Grading of TME specimens is based on the macroscopic assessment of the mesorectum and standardized through synoptic pathology reporting. TME grade is a strong predictor of outcomes with incomplete (IC) TME associated with increased rates of local recurrence relative to complete or near complete (NC) TME. Although TME grade serves as an endpoint in most rectal cancer trials, in protocols incorporating centralized review of TME specimens for quality assurance, discordance in grading and the management thereof has not been previously described.

METHODS

A phase 2 prospective transanal TME trial was conducted from 2017 to 2022 across 11 North American centers with TME quality as the primary study endpoint. QC measures included (1) training of site pathologists in TME protocols, (2) blinded grading of de-identified TME specimen photographs by central pathologists, and (3) reconciliation of major discordance before trial reporting. Cohen Kappa statistic was used to assess agreement in grading.

RESULTS

Overall agreement in grading of 100 TME specimens between site and central reviewer was rated as fair, (κ = 0.35; 95% CI: 0.10-0.61; P < 0.0001). Concordance was noted in 54%, with minor and major discordance in 32% and 14% of cases, respectively. Upon reconciliation, 13/14 (93%) major discordances were resolved. Pre versus postreconciliation rates of complete or NC and IC TME are 77%/16% and 7% versus 69%/21% and 10%. Reconciliation resulted in a major upgrade (IC-NC; N = 1) or major downgrade (NC/C-IC, N = 4) in 5 cases overall (5%).

CONCLUSIONS

A 14% rate of major discordance was observed in TME grading between the site and central reviewers. The resolution resulted in a major change in final TME grade in 5% of cases, which suggests that reported rates or TME completeness are likely overestimated in trials. QC through a central review of TME photographs and reconciliation of major discordances is strongly recommended.

Building infrastructure to teach quality improvement

With growing emphasis on healthcare quality improvement (QI) at both national and local levels, there has been increased demand for instructional programs to teach quality improvement as a discipline. Design of QI teaching programs must take into account local resources as well as the background and competing commitments of the learner.  In this article, we review elements of successful quality improvement training programs including structure of didactic and experiential curricula. Special considerations for training programs at the undergraduate and graduate medical, hospital, and national/professional society level are presented.

Longitudinal Rates, Patient Risk Factors, and Economic Impact of Superficial and Deep Incisional Surgical Site Infection After Primary and Revision Total Hip Arthroplasty: A U.S. Retrospective Commercial Claims Database Analysis

Background: Longitudinal rates, risk factors, and costs of superficial and deep incisional surgical site infection (SSI) were evaluated six months after primary total hip arthroplasty (pTHA) and revision total hip replacement (rTHA). Patients and Methods: Patients who had pTHA or rTHA between January 1, 2016 and March 31, 2018 were identified using the IBM^® MarketScan^® administrative claims databases. Kaplan-Meier survival curves evaluated time to SSI over six months. Cox proportional hazard models evaluated SSI risk factors. Generalized linear models estimated SSI costs up to 12 months. Results: The total cohort included 17,514 pTHA patients (mean [standard deviation] age 59.6 [10.1] years, 50.2% female; 66.4% commercial insurance), and 2,954 rTHA patients (61.2 [12.0] years, 52.0% female; 48.6% commercial insurance). Deep and superficial post-operative SSI at six months affected 0.30% (95% confidence interval [CI], 0.22%-0.39%) and 0.67% (95% CI, 0.55%-0.79% of patients in the pTHA, and 8.9% (95%CI: 7.8%-10.0%) and 4.8% (95% CI, 4.0%-5.6%) of patients in the rTHA cohorts. Hazards for SSI were related to patient comorbidities that included diabetes mellitus, obesity, renal failure, pulmonary or circulatory disorders, and depression. The adjusted average all-cause incremental commercial costs associated with post-operative infection ranged from $21,434 to $42,879 for superficial incisional SSI and $53,884 to $76,472 for deep incisional SSI, over a 12-month post-operative assessment period. Conclusions: The SSI rate after revision total hip arthroplasty (rTHA) was nearly 9% compared with 1.0% after pTHA. The risk of infection was influenced by several comorbid risk factors. The incremental cost associated with SSIs was substantial.