The Impact of Feedback of Surgical Outcome Data on Surgical Performance: A Systematic Review

Comparing Peer and Faculty Feedback for Asynchronous Laparoscopic Skill Acquisition

OBJECTIVE

Traditionally, expert surgeons have provided surgical trainees with feedback about their simulation performance, including for asynchronous practice. Unfortunately, innumerable time demands may limit experts' ability to provide feedback. It is unknown whether and how peer feedback is an effective mechanism to help residents acquire laparoscopic skill in an asynchronous setting. As such, we aimed to assess the effect of peer feedback on laparoscopic performance and determine how residents perceive giving and receiving peer feedback.

DESIGN

We conducted a convergent mixed methods study. In the quantitative component, we randomized residents to receive feedback on home laparoscopic tasks from peers or faculty. We then held an end-of-curriculum, in-person laparoscopic assessment with members from both groups and compared performance on the in-person assessment between the groups. In the qualitative component, we conducted interviews with resident participants to explore experiences with feedback and performance. Three authors coded and rigorously reviewed interview data using a directed content analysis.

SETTING

We performed this study at a single tertiary academic institution: the University of California, San Francisco.

PARTICIPANTS

We invited 47 junior residents in general surgery, obstetrics-gynecology, and urology to participate, of whom 37 (79%) participated in the home curriculum and 25 (53%) participated in the end-of-curriculum assessment.

RESULTS

Residents in the peer feedback group scored similarly on the final assessment (mean 70.7%; SD 16.1%) as residents in the faculty feedback group (mean 71.8%; SD 11.9%) (p = 0.86). Through qualitative analysis of interviews with 13 residents, we identified key reasons for peer feedback's efficacy: shared mental models, the ability to brainstorm and appreciate new approaches, and a low-stakes learning environment.

CONCLUSIONS

We found that peer and faculty feedback led to similar performance in basic laparoscopy and that residents engaged positively with peer feedback, suggesting that peer feedback can be used when residents learn basic laparoscopy.

Patient sentiment regarding stroke: Analysis of 2,992 social media posts

INTRODUCTION

Social media reflects personalized sentiment toward disease and increasingly impacts perceptions of treatment options. This study aims to assess patients experience with and perception of stroke through an analysis of social media posts.

METHODS

A variety of terms ("stroke", "stroke survivor", "stroke rehab", "stroke recovery") were used to search for possible qualified posts on Twitter and Instagram. Twitter posts containing "#stroke" and "@stroke" were identified, yielding 2,506 Twitter posts relating to the patient's own experience. Four hundred sixty-eight public Instagram posts marked under "#stroke" and "@stroke," including direct references to the patient's own experience, were analyzed. First vs. recurrent stroke was identified when possible. The posts were coded for themes relating to patient experience with the disease.

RESULTS

The most common Twitter theme was raising stroke awareness (23.4 %), while spreading positivity was the most common Instagram theme (66.7 %). Most Twitter posts (93.9 %) were from patients experiencing their first stroke, with only 6.1 % of the posts being about recurrent strokes. Women created the majority of Instagram (75.7 %) and Twitter (77.3 %) posts. Men were more likely to discuss mobility/functional outcomes (p = 0.001) and survival/death (p = 0.014), while women were more likely to recount symptoms (p = 0.014), depression (p = 0.002), fear (p<0.001), and mental health (p = 0.006).

CONCLUSION

Stroke patients most often describe their quality of life and discuss raising awareness via social media. Men and women differ in the most commonly shared aspects of their stroke experience. Gauging social media sentiment may guide physicians toward better counseling and psychosocial management of stroke patients.

Audit, Feedback, and Education to Improve Quality and Outcomes in Transurethral Resection and Single-Instillation Intravesical Chemotherapy for Nonmuscle Invasive Bladder Cancer Treatment: Protocol for a Multicenter International Observational Study With an Embedded Cluster Randomized Trial

BACKGROUND

Nonmuscle invasive bladder cancer (NMIBC) accounts for 75% of bladder cancers. It is common and costly. Cost and detriment to patient outcomes and quality of life are driven by high recurrence rates and the need for regular invasive surveillance and repeat treatments. There is evidence that the quality of the initial surgical procedure (transurethral resection of bladder tumor [TURBT]) and administration of postoperative bladder chemotherapy significantly reduce cancer recurrence rates and improve outcomes (cancer progression and mortality). There is surgeon-reported evidence that TURBT practice varies significantly across surgeons and sites. There is limited evidence from clinical trials of intravesical chemotherapy that NMIBC recurrence rate varies significantly between sites and that this cannot be accounted for by differences in patient, tumor, or adjuvant treatment factors, suggesting that how the surgery is performed may be a reason for the variation.

OBJECTIVE

This study primarily aims to determine if feedback on and education about surgical quality indicators can improve performance and secondarily if this can reduce cancer recurrence rates. Planned secondary analyses aim to determine what surgeon, operative, perioperative, institutional, and patient factors are associated with better achievement of TURBT quality indicators and NMIBC recurrence rates.

METHODS

This is an observational, international, multicenter study with an embedded cluster randomized trial of audit, feedback, and education. Sites will be included if they perform TURBT for NMIBC. The study has four phases: (1) site registration and usual practice survey; (2) retrospective audit; (3) randomization to audit, feedback, and education intervention or to no intervention; and (4) prospective audit. Local and national ethical and institutional approvals or exemptions will be obtained at each participating site.

RESULTS

The study has 4 coprimary outcomes, which are 4 evidence-based TURBT quality indicators: a surgical performance factor (detrusor muscle resection); an adjuvant treatment factor (intravesical chemotherapy administration); and 2 documentation factors (resection completeness and tumor features). A key secondary outcome is the early cancer recurrence rate. The intervention is a web-based surgical performance feedback dashboard with educational and practical resources for TURBT quality improvement. It will include anonymous site and surgeon-level peer comparison, a performance summary, and targets. The coprimary outcomes will be analyzed at the site level while recurrence rate will be analyzed at the patient level. The study was funded in October 2020 and began data collection in April 2021. As of January 2023, there were 220 hospitals participating and over 15,000 patient records. Projected data collection end date is June 30, 2023.

CONCLUSIONS

This study aims to use a distributed collaborative model to deliver a site-level web-based performance feedback intervention to improve the quality of endoscopic bladder cancer surgery. The study is funded and projects to complete data collection in June 2023.

TRIAL REGISTRATION

ClinicalTrials.org NCT05154084; https://clinicaltrials.gov/ct2/show/NCT05154084.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/42254.

American College of Surgeons Objective Assessment of Skills in Surgery (ACS OASIS): A Formative Assessment of Junior Residents' Technical Skills

OBJECTIVE

The objective assessment of technical skills of junior residents is essential in implementing competency-based training and providing specific feedback regarding areas for improvement. An innovative assessment that can be easily implemented by training programs nationwide has been developed by expert surgeon educators under the aegis of the American College of Surgeons (ACS) Division of Education. This assessment, ACS Objective Assessment of Skills in Surgery (ACS OASIS) uses eight stations to address technical skills important for junior residents within the domains of laparoscopic appendectomy, excision of lipoma, central line placement, laparoscopic cholecystectomy, trocar placement, exploratory laparotomy, repair of enterotomy, and tube thoracostomy. The purpose of this study was to implement ACS OASIS at a number of sites to study its psychometric rigor.

DESIGN

The ACS OASIS was pre-piloted at two programs to establish feasibility and to gather information regarding implementation. Each skills station was 12 minutes long, and the faculty completed a checklist with 5 to 15 items, and a global assessment scale. The study was then repeated at three pilot sites and included 29 junior residents who were assessed by a total of 44 faculty. Psychometric data for the stations and checklists were collected and analyzed.

SETTING

The pre-pilot sites were Geisinger and University of Tennessee Knoxville.Data were gathered from pilot sites that included Wellspan Health, Duke University, and University of California Los Angeles.

RESULTS

The mean checklist score for all learners was 76% (IQR of 66%-85%). The average global rating was 3.36 on a 5-point scale with a standard deviation of 0.56. The overall cut score derived using the borderline group method was at 68% with 34% of performances requiring remediation. Using this criterion, the average number of stations that were completed by each learner without need for remediation was five.The station discrimination index ranged from 0.27 to 0.65 (all above the threshold of 0.25), demonstrating solid psychometric characteristics at the station level. The internal-consistency reliability was 0.76 with SEM of 5.8%. The inter-rater reliability (intraclass correlation) was high at 0.73 with general agreement of 79% between the two raters. The station discrimination was at 0.45 (range of 0.27 to 0.65) indicating a high level of differentiation between high and low performers. Using the generalizability theory, the G-coefficient reliability was at 0.72 with the reliability projection flattening after 8 stations. Overall, 75% to 82% the faculty and learners rated ACS OASIS as realistic and beneficial.

CONCLUSIONS

ACS OASIS is a psychometrically sound technical skills assessment tool that can provide useful information for feedback to junior residents and support efforts to remediate gaps in performance.

Learning outcomes of structured perioperative teaching based on adult learning

BACKGROUND

Self-directed learning is the cornerstone of adult learning. The aim of the study was to investigate the improvement of core competency and increase interest to be a surgeon among medical students after a perioperative training through a structured learning with written record model. The mediating role of adult learning pattern on core competency was also examined.

METHODS

A 2-week training protocol was based on a structural learning model which included a structured written record by the learner for postoperative immediate feedback. An adult learning questionnaire (ALQ) was developed to assess learners' adult learning pattern and a clinical core competency questionnaire (CCCQ) was developed to assess learning outcomes. A two-way repeated measured of ANCOVA would be used to analyze the interaction effect of adult learning pattern and learning effect on learning outcomes.

RESULTS

From Jan 2017 to Dec 2019, 412 medical students were enrolled in the study. The increase scores of CCCQ and a significant numbers of increase interest to be a surgeon were shown after the perioperative training. Two-way repeated measure ANOVA revealed that there were significant differences in change between pre- and post-CCCQ across four levels of ALQ (interaction effect F = 13.0, p <0.001). The more adult learning patterns medical students own, the more they will benefit from the training.

CONCLUSIONS

The structural learning with written record model provides an effective perioperative training represented with clinical core competency and increase the interest to be a surgeon in the future. Medical students with tendency of adult learning pattern would learn better.

Resident evaluations in the age of competency-based medical education: faculty perspectives on minimizing burdens

OBJECTIVE

Competency-based medical education (CBME), an outcomes-based approach to medical education, continues to be implemented across many postgraduate medical education programs worldwide, including a recent introduction into Canadian neurosurgical training programs (July 2019). The success of this educational paradigm shift requires frequent faculty observation and evaluation of residents performing defined tasks of the specialty. A main challenge involves providing residents with frequent performance evaluations and feedback that are feasible for faculty to complete. This study aims to define what is currently happening and what changes are needed to make CBME successful for the certification of neurosurgeons' competence.

METHODS

A 55-item questionnaire was emailed nationwide to survey Canadian neurosurgical faculty.

RESULTS

Fifty-two complete responses were received and achieved a distribution highly correlated with the number of faculty neurosurgeons practicing in each Canadian province (Pearson's r = 0.94). Two-thirds (35/52) of faculty reported currently taking a median of 10 minutes to complete evaluation forms at the end of a resident's rotation block. Regardless of the faculty's province of practice (p = 0.50) or years of experience (p = 0.06), they reported 3 minutes (minimum 1 minute, maximum 10 minutes, interquartile range [IQR] 3 minutes) as a feasible amount of time to spend completing an evaluation form following an observation of a resident's performance of an entrustable professional activity (EPA). If evaluation forms took 3 minutes to complete, 85% of respondents (44/52) would complete EPA evaluations weekly or daily. The faculty recommended 5 minutes as a feasible amount of time to provide oral feedback (minimum 1 minute, maximum 20 minutes, IQR 3.25 minutes), which was significantly higher (p = 0.00099) than their recommended amount of time for completing evaluation forms. The majority of faculty (71%) stated they would prefer to access resident evaluation forms through a mobile application compared to a paper form (12%), an evaluation website (8%), or through a URL link sent via email (10%; p = 0.0032).

CONCLUSIONS

To facilitate the successful implementation of CBME into a neurosurgical training curriculum, resident EPA assessment forms should take 3 minutes or less to complete and be accessible through a mobile application.

Early recognition and response to increases in surgical site infections using optimized statistical process control charts-the Early 2RIS Trial: a multicenter cluster randomized controlled trial with stepped wedge design

Background

Surgical site infections (SSIs) cause significant patient suffering. Surveillance and feedback of SSI rates is an evidence-based strategy to reduce SSIs, but traditional surveillance methods are slow and prone to bias. The objective of this cluster randomized controlled trial (RCT) is to determine if using optimized statistical process control (SPC) charts for SSI surveillance and feedback lead to a reduction in SSI rates compared to traditional surveillance.

Methods

The Early 2RIS Trial is a prospective, multicenter cluster RCT using a stepped wedge design. The trial will be performed in 29 hospitals in the Duke Infection Control Outreach Network (DICON) and 105 clusters over 4 years, from March 2016 through February 2020; year one represents a baseline period; thereafter, 8–9 clusters will be randomized to intervention every 3 months over a 3-year period using a stepped wedge randomization design. All patients who undergo one of 13 targeted procedures at study hospitals will be included in the analysis; these procedures will be included in one of six clusters: cardiac, orthopedic, gastrointestinal, OB-GYN, vascular, and spinal. All clusters will undergo traditional surveillance for SSIs; once randomized to intervention, clusters will also undergo surveillance and feedback using optimized SPC charts. Feedback on surveillance data will be provided to all clusters, regardless of allocation or type of surveillance. The primary endpoint is the difference in rates of SSI between the SPC intervention compared to traditional surveillance and feedback alone.

Discussion

The traditional approach for SSI surveillance and feedback has several major deficiencies because SSIs are rare events. First, traditional statistical methods require aggregation of measurements over time, which delays analysis until enough data accumulate. Second, traditional statistical tests and resulting p values are difficult to interpret. Third, analyses based on average SSI rates during predefined time periods have limited ability to rapidly identify important, real-time trends. Thus, standard analytic methods that compare average SSI rates between arbitrarily designated time intervals may not identify an important SSI rate increase on time unless the “signal” is very strong. Therefore, novel strategies for early identification and investigation of SSI rate increases are needed to decrease SSI rates. While SPC charts are used throughout industry and healthcare to improve and optimize processes, including other types of healthcare-associated infections, they have not been evaluated as a tool for SSI surveillance and feedback in a randomized trial.

Trial registration

ClinicalTrials.govNCT03075813, Registered March 9, 2017.

The impact of improving teamwork on patient outcomes in surgery: A systematic review

BACKGROUND

The aviation industry pioneered formalised crew training in order to improve safety and reduce consequences of non-technical error. This formalised training has been successfully adapted and used to in the field of surgery to improve post-operative patient outcomes. The need to implement teamwork training as an integral part of a surgical programme is increasingly being recognised. We aim to systematically review the impact of surgical teamwork training on post-operative outcomes.

METHODS

Two independent researchers systematically searched MEDLINE and Embase in accordance with PRISMA guidelines. Studies were screened and subjected to inclusion/exclusion criteria. Study characteristics and outcomes were reported and analysed.

RESULTS

Our initial search identified 2720 articles. Following duplicate removal, title and abstract screening, 107 full text articles were analysed. Eight articles met our inclusion criteria. Overall, three articles supported a positive effect of good teamwork on post-operative patient outcomes. We identified key areas in study methodology that can be improved upon, including small cohort size, lack of unified training programme, and short training duration, should future studies be designed and implemented in this field.

CONCLUSION

At present, there is insufficient evidence to support the hypothesis that teamwork training interventions improve patient outcomes. We believe that non-significant and conflicting results can be attributed to flaws in methodology and non-uniform training methods. With increasing amounts of evidence in this field, we predict a positive association between teamwork training and patient outcomes will come to light.

Maintaining Quality in Lower Volume Cardiac Surgery: A Blueprint From a Military Program

Although there is a clear volume-outcome relationship in the field of cardiac surgery, the existence of high-performing programs with relatively low case volumes is well established. This report describes the programmatic and institutional processes in place at a lower volume cardiac surgery center in a US military hospital, which have been executed to optimally leverage available resources in the delivery of exemplary patient care. By implementing a highly collaborative practice, rigorous outcomes review, evidence-based standardized care pathways, consistent attending surgeon oversight for care delivery, careful case selection, and a mechanism for support from highly experienced outside cardiac surgeons, the cardiac surgery program at the authors' institution delivers care on par with its higher volume counterparts. A review of these practices and available supporting evidence may provide a model for other programs seeking success in this setting.

Development of a surgical site infection prediction model in orthopaedic trauma: The Denver Health Model

BACKGROUND

The CDC's National Healthcare Safety Network's (NHSN) current risk adjustment model for surgical site infections (SSI) following open reduction internal fixation (ORIF) of long bone fractures is a suboptimal predictor of risk. We hypothesized that by including variables known to be associated with SSI following ORIF, we would develop a model that would increase the accuracy and predictability of SSI risk.

METHODS

Patients who underwent ORIF of a long bone between January 1, 2012 and December 31, 2014 were included in the study (n=1543). Patient risk factors, injury risk factors and perioperative risk factors were considered in the development of this model. We developed a risk prediction model for SSI following ORIF and then applied this to a new dataset of ORIF to determine the expected number of infections. This was compared to the expected number of infections calculated using the NHSN risk adjusted model.

RESULTS

The final multivariate model included age (odds ratio: 1.02, p-value<0.001, 95% confidence interval: 1.00-1.04), lower leg fracture (2.63, 0.004, 1.40-4.93), open fracture (1.87, 0.07, 0.93-3.76), American Society of Anesthesiologists (ASA) (2.09, 0.02, 1.07-4.08) and history of methicillin-resistant Staphylococcus aureus (MRSA), which was the most important predictor of infection (7.20, <0.001, 2.61-19.85). The c-index was 0.74 compared to 0.65 for the NHSN model, indicating that our model more accurate in estimating infection risk. When the developed model was used to predict the number of expected infections on a new dataset from 2015, 36.3 SSI were expected compared to 5.7 calculated by the NHSN model.

CONCLUSIONS

The model that was developed uses five easily identifiable risk factors that result in a more accurate prediction of infection at our facility than the currently used model.

LEVEL OF EVIDENCE

Prognostic and epidemiologic study, level III.

Hypothyroidism is a Risk Factor for Atrial Fibrillation after Coronary Artery Bypass Graft

INTRODUCTION

Few reports in the world have shown a differential effect of hypothyroidism in relation to morbidity and mortality following cardiac surgery.

OBJECTIVE

To determine the association between preoperative hypothyroidism, composite and disaggregated outcomes of mortality and complications in patients undergoing first-time isolated myocardial revascularization surgery.

METHODS

Historical cohort of patients undergoing myocardial revascularization between January 2008 and December 2014, with 626 patients included for evaluation of the composite and disaggregated outcomes of in-hospital mortality and complications (atrial fibrillation, surgical site infection and reoperation due to bleeding). A logistic regression model was used to determine the association between hypothyroidism and the onset of those outcomes.

RESULTS

Cohort of 1696 eligible patients for the study, with 1.8 mortality. Median age, female gender and prevalence of arterial hypertension were all significantly higher among hypothyroid patients. No differences were found in other preoperative or intraoperative characteristics. Hypothyroidism was associated with the presence of the composite outcome, RR 1.6 (1.04-2.4) and atrial fibrillation 1.9 (1.05-3.8). No association with mortality, infections or reoperation due to bleeding was found.

CONCLUSION

Hypothyroidism is a disease that affects females predominantly and does not determine the presence of other comorbidities. Hypothyroidism is a risk factor for the onset of postoperative fibrillation in patients undergoing myocardial revascularization surgery. Postoperative care protocols focused on the prevention of these complications in this type of patients must be instituted.

Initial Comparison of Resident and Attending Milestones Evaluations in Plastic Surgery

BACKGROUND

Graduate medical education has recently undergone a major archetypal shift toward competency-based evaluations of residents' performance. The implementation of the Milestones program by the Accreditation Council for Graduate Medical Education (ACGME) is a core component of the shift, designed to ensure uniformity in measuring residency knowledge using a series of specialty-specific achievements. This study evaluates the correlation between residents' self-evaluations and program directors' assessments of their performance.

METHODS

The study population comprised 12 plastic surgery residents, ranging from postgraduate year 1 to postgraduate year 6, enrolled in an integrated residency program at a single institution.

RESULTS

Overall, average attending scores were lower than average resident scores at all levels except postgraduate year 6. Correlation between resident and attending evaluations ranged from 0.417 to 0.957, with the correlation of average scores of Patient Care (0.854) and Medical Knowledge (0.816) Milestones significantly higher than those of professional skillsets (0.581). "Patient care, facial esthetics" was the Milestone with the lowest average scores from both groups. Residents scored themselves notably higher than their attendings' evaluations in Practice-based Learning and Improvement categories (+0.958) and notably lower in Medical Knowledge categories such as "Cosmetic Surgery, Trunk and Lower Extremities" (-0.375) and "Non-trauma hand" (-0.208). The total possible number of participants in this study was 12. The actual number of participants was 12 (100%).

CONCLUSIONS

The remarkable range of correlations suggests that expectations for performance standards may vary widely between residents and program directors. Understanding gaps between expectations and performance is vital to inform current and future residents as the restructuring of the accreditation process continues.

Individual surgeon is an independent risk factor for leak after double-stapled colorectal anastomosis: An institutional analysis of 800 patients

BACKGROUND

Our aim was to assess whether the individual surgeon is an independent risk factor for anastomotic leak in double-stapled colorectal anastomosis after left colon and rectal cancer resection.

METHODS

This retrospective analysis of a prospectively collected database consists of a consecutive series of 800 patients who underwent an elective left colon and rectal resection with a colorectal, double-stapled anastomosis between 1993 and 2009 in a specialized colorectal unit of a tertiary hospital with 7 participating surgeons. The main outcome variable was anastomotic leak, defined as leak of luminal contents from a colorectal anastomosis between 2 hollow viscera diagnosed radiologically, clinically, endoscopically, or intraoperatively. Pelvic abscesses were also considered to be an anastomotic leak. Radiologic examination was performed when there was clinical suspicion of leak.

RESULTS

Anastomotic leak occurred in 6.1% of patients, of which 33 (67%) were treated operatively, 6 (12%) with radiologic drains, and 10 (21%) by medical treatment. Postoperative mortality rate was 2.9% for the whole group of 800 patients. In patients with anastomotic leak, mortality rate increased up to 16% vs 2.0% in patients without anastomotic leak (P < .0001). At multivariate analysis, rectal location of tumor, male sex, bowel obstruction preoperatively, tobacco use, diabetes, perioperative transfusion, and the individual surgeon were independent risk factors for anastomotic leak. The surgeon was the most important factor (mean odds ratio 4.9; range 1.0 to 13.5). The variance of anastomotic leak between the different surgeons was 0.56 in the logit scale.

CONCLUSION

The individual surgeon is an independent risk factor for leakage in double-stapled, colorectal, end-to-end anastomosis after oncologic left-sided colorectal resection.

Disparities in Feedback Provision to Emergency Medical Services Professionals

INTRODUCTION

Feedback to EMS professionals is a critical component for optimizing patient care and outcomes in the prehospital setting. There is a paucity of data concerning the feedback received by prehospital providers.

OBJECTIVES

The objective of this study was to describe the prevalence of feedback received by EMS professionals in the past 30 days including the types, sources, modes, and utility of feedback. The secondary objective was to identify factors associated with receiving any feedback and, specifically, feedback regarding medical care provided.

METHODS

This was a cross-sectional survey examining currently practicing nationally certified EMS patient care providers (EMT or higher) in non-military and non-tribal settings. Data were collected on provider characteristics along with feedback received. Descriptive statistics were calculated, and multivariable logistic regression models were constructed to assess the relationship between EMS provider characteristics and receiving feedback. A non-respondent survey was administered to assess for non-response bias.

RESULTS

Responses from 32,314 EMS providers were received (response rate = 10.4%) with 15,766 meeting inclusion criteria. In the 30 days preceding the survey, 69.4% (n = 10,924) of respondents received at least one type of feedback with 54.7% (n = 8,592) reporting receiving medical care feedback. Multivariable logistic regression modeling indicated that higher certification level, fewer years of experience in EMS, working for a hospital-based agency, air medical service, and higher weekly call volumes were significantly associated with increased odds of having received at least one type of feedback, and specifically medical care feedback. Additionally, providing primarily medical/convalescent transport and more years of EMS experience were significantly associated with decreased odds of receiving feedback.

CONCLUSION

Feedback to EMS providers is critical to improving prehospital care. In this study, nearly a third of providers did not receive any feedback in a 30-day period, and nearly half reported not receiving medical care feedback. Disparities in the frequency of feedback exist between different provider levels and service settings, while reported feedback decreased with years of experience in the profession. Future work is needed to assess the content of feedback and role in improving patient care and safety.

Quality Improvement Initiatives in Colorectal Surgery: Value of Physician Feedback

BACKGROUND

The impact of process improvement through surgeon feedback on outcomes is unclear.

OBJECTIVE

We sought to evaluate the effect of biannual surgeon-specific feedback on outcomes and adherence to departmental and Surgical Care Improvement Project process measures on colorectal surgery outcomes.

DESIGN

This was a retrospective analysis of prospectively collected 100% capture surgical quality improvement data.

SETTING

This study was conducted at the department of colorectal surgery at a tertiary care teaching hospital from January 2008 through December 2013.

MAIN OUTCOME MEASURES

Each surgeon was provided with biannual feedback on process adherence and surgeon-specific outcomes of urinary tract infection, deep vein thrombosis, surgical site infection, anastomotic leak, 30-day readmission, reoperation, and mortality. We recorded adherence to Surgical Care Improvement Project process measures and departmentally implemented measures (ie, anastomotic leak testing) as well as surgeon-specific outcomes.

RESULTS

We abstracted 7975 operations. There was no difference in demographics, laparoscopy, or blood loss. Adherence to catheter removal increased from 73% to 100% (p < 0.0001), whereas urinary tract infection decreased 52% (p < 0.01). Adherence to thromboprophylaxis administration remained unchanged as did the deep vein thrombosis rate (p = not significant). Adherence to preoperative antibiotic administration increased from 72% to 100% (p < 0.0001), whereas surgical site infection did not change (7.6%-6.6%; p = 0.3). There were 2589 operative encounters with anastomoses. For right-sided anastomoses, the proportion of handsewn anastomoses declined from 19% to 1.5% (p < 0.001). For left-sided anastomoses, without diversion, anastomotic leak testing adherence increased from 88% to 95% (p < 0.01). Overall leak rate decreased from 5.2% to 2.9% (p < 0.05).

LIMITATIONS

Concurrent process changes make isolation of the impact from individual process improvement changes challenging.

CONCLUSIONS

Nearly complete adherence to process measures for deep vein thrombosis and surgical site infection did not lead to measureable outcomes improvement. Process measure adherence was associated with decreased rate of anastomotic leak and urinary tract infection. Biannual surgeon-specific feedback of outcomes was associated with improved process measure adherence and improvement in surgical quality.

Guidance on feedback of outcome data to improve performance in vascular surgery

Feedback of performance data is a well-established method of performance improvement in the health-care setting, although guidance has been limited in the context of surgical performance. This article outlines how optimal feedback can be achieved using surgeon outcome data.