Systematic review of methodological quality of individual performance measurement in surgery

Effect of centre volume on pathological outcomes and postoperative complications after surgery for colorectal cancer: results of a multicentre national study

BACKGROUND

The association between volume, complications and pathological outcomes is still under debate regarding colorectal cancer surgery. The aim of the study was to assess the association between centre volume and severe complications, mortality, less-than-radical oncologic surgery, and indications for neoadjuvant therapy.

METHODS

Retrospective analysis of 16,883 colorectal cancer cases from 80 centres (2018-2021). Outcomes: 30-day mortality; Clavien-Dindo grade >2 complications; removal of ≥ 12 lymph nodes; non-radical resection; neoadjuvant therapy. Quartiles of hospital volumes were classified as LOW, MEDIUM, HIGH, and VERY HIGH. Independent predictors, both overall and for rectal cancer, were evaluated using logistic regression including age, gender, AJCC stage and cancer site.

RESULTS

LOW-volume centres reported a higher rate of severe postoperative complications (OR 1.50, 95% c.i. 1.15-1.096, P = 0.003). The rate of ≥ 12 lymph nodes removed in LOW-volume (OR 0.68, 95% c.i. 0.56-0.85, P < 0.001) and MEDIUM-volume (OR 0.72, 95% c.i. 0.62-0.83, P < 0.001) centres was lower than in VERY HIGH-volume centres. Of the 4676 rectal cancer patients, the rate of ≥ 12 lymph nodes removed was lower in LOW-volume than in VERY HIGH-volume centres (OR 0.57, 95% c.i. 0.41-0.80, P = 0.001). A lower rate of neoadjuvant chemoradiation was associated with HIGH (OR 0.66, 95% c.i. 0.56-0.77, P < 0.001), MEDIUM (OR 0.75, 95% c.i. 0.60-0.92, P = 0.006), and LOW (OR 0.70, 95% c.i. 0.52-0.94, P = 0.019) volume centres (vs. VERY HIGH).

CONCLUSION

Colorectal cancer surgery in low-volume centres is at higher risk of suboptimal management, poor postoperative outcomes, and less-than-adequate oncologic resections. Centralisation of rectal cancer cases should be taken into consideration to optimise the outcomes.

Should we screen aging physicians for cognitive decline?

OBJECTIVES

To synthesize evidence relevant for informed decisions concerning cognitive testing of older physicians.

METHODS

Relevant literature was systematically searched in Medline, EMBASE, PsycInfo, and ERIC, with key findings abstracted and synthesized.

RESULTS

Cognitive abilities of physicians may decline in an age range where they are still practicing. Physician competence and clinical performance may also decline with age. Cognitive scores are lower in physicians referred for assessment because of competency or performance concerns. Many physicians do not accurately self-assess and continue to practice despite declining quality of care; however, perceived cognitive decline, although not an accurate indicator of ability, may accelerate physicians' decision to retire. Physicians are reluctant to report colleagues' cognitive problems. Several issues should be considered in implementing cognitive screening. Most cognitive assessment tools lack normative data for physicians. Scientific evidence linking cognitive test results with physician performance is limited. There is no known level of cognitive decline at which a doctor is no longer fit to practice. Finally, relevant domains of cognitive ability vary across medical specialties.

CONCLUSION

Physician cognitive decline may impact clinical performance. If cognitive assessment of older physicians is to be implemented, it should consider challenges of cognitive test result interpretation.

Achievement of benchmark outcomes by a young surgical attendant performing pancreatoduodenectomies

PURPOSE

Pancreatoduodenectomy is a challenging procedure for young general surgeons, and no benchmark outcomes are currently available for young surgeons who have independently performed pancreatoduodenectomies after completing resident training. This study aimed to identify the competency of a young surgeon in performing pancreatoduodenectomies, while ensuring patient safety, from the first case following certification by a General Surgical Board.

METHODS

A retrospective review of data from the university hospital was performed to assess quality outcomes of a young surgical attendant who performed 150 open pancreatoduodenectomies between July 13, 2006, and July 13, 2020. Primary benchmark outcomes were hospital morbidity, mortality, postoperative pancreatic fistula, postoperative hospital stay, and disease-free survival.

RESULTS

All benchmark outcomes were achieved by the young surgeon. The 90-day mortality rate was 2.7%, and one patient expired in the hospital (0.7% in-hospital mortality). The overall morbidity rate was 34.7%. Postoperative pancreatic fistula grades B and C were observed in 5.3% and 0% of patients, respectively. The median postoperative hospital stay was 14 days. The 1- and 3-year disease-free survival were 71.3% and 51.4%, respectively.

CONCLUSION

Pancreatoduodenectomy requires good standards of care as it is associated with high morbidity and mortality. As only one surgeon could be included in this study, our benchmark outcomes must be compared with those of other institutions.

CLINICAL TRIAL REGISTRATION

The study was registered at Thai Clinical Trials Registry and approved by the United Nations (registration identification TCTR20220714002).

Influence of surgical performance on clinical outcome after osteosynthesis of distal radius fracture

INTRODUCTION

Clinical outcome after surgery depends on the surgeon's level of expertise or performance. The present study of minimally invasive plate osteosynthesis (MIPO) with anterior plate for distal radius fracture assessed whether clinical outcome correlated with surgeon performance.

METHODS

The series included 30 distal radius fractures: 15 operated on by 4 level III surgeons (Group 1) and 15 by 4 level V surgeons (Group 2), utilizing the MIPO technique. The surgical performance of all 8 surgeons was assessed using the OSATS global rating scale. Clinical outcomes were assessed at 3 months' follow-up using the modified Mayo score (MMS), in 4 grades: 0-64 (poor), 65-79 (moderate), 80-89 (good), and 90-100 (excellent). The QuickDASH score (QDASH) was also calculated, and complications were recorded.

RESULTS

Median MMS was better for level V (75 = fair result) than level III surgeons (62 = poor result). Median QDASH score likewise was better in group 2 (9.1) than group 1 (22.7). In group 1, there were 2 paresthesias in the median nerve territory, 1 type-1 complex regional pain syndrome, and 1 hypoesthesia in the scar area. Mean correlation between the 2 scores was -0.68. Group 1 patients were on average 7 years older. The number of patients, number of surgeons and distribution of OA A and C fractures were almost identical in the two groups. On MMS, the overall result of the two groups was moderate (70.5), which can be explained by short mean follow-up.

DISCUSSION

Quality of the clinical outcome on MMS and QDASH increased with surgical performance, with fewer complications. In the patients' interest, protocols for improving surgical performance should be implemented, for example, through deliberate practice.

The neurophysiology of intraoperative error: An EEG study of trainee surgeons during robotic-assisted surgery simulations

Surgeons operate in mentally and physically demanding workspaces where the impact of error is highly consequential. Accurately characterizing the neurophysiology of surgeons during intraoperative error will help guide more accurate performance assessment and precision training for surgeons and other teleoperators. To better understand the neurophysiology of intraoperative error, we build and deploy a system for intraoperative error detection and electroencephalography (EEG) signal synchronization during robot-assisted surgery (RAS). We then examine the association between EEG data and detected errors. Our results suggest that there are significant EEG changes during intraoperative error that are detectable irrespective of surgical experience level.

Learning curve of transoral robotic thyroidectomy

BACKGROUND

Transoral thyroidectomy has superior cosmesis and better postoperative voice outcomes than conventional thyroidectomy. However, it usually requires a steep learning curve and longer operative time. The transoral robotic thyroidectomy (TORT) learning curve has not been well investigated. This study aimed to evaluate the TORT learning curve and factors affecting operative time.

METHODS

We retrospectively studied 173 consecutive patients who underwent TORT with or without central neck dissection from July 2017 to August 2021. We assessed the TORT learning curve using operative time, complication rate, and surgical success (procedure conversion) rate. The operative time and surgical success rate learning curves were calculated using the cumulative summation (CUSUM) method. Additionally, we analyzed factors affecting operative time in TORT.

RESULTS

Total thyroidectomy operative time was significantly longer than those of lobectomy and isthmusectomy (p < 0.001). In correlation analysis, a significantly positive correlation was observed between body mass index (BMI) and operative time (R² = 0.04, p = 0.025). The TORT learning curve was 52 cases in the CUSUM operative time analysis. In the CUSUM surgical success rate chart, the turning point was the 55th case. Complication and procedure conversion rates were significantly decreased after the learning curve.

CONCLUSIONS

The CUSUM learning curve of TORT was about 52-55 cases, and the operative time, total complication rate, and procedure conversion decreased significantly after the learning curve. The operative time was associated with the extent of thyroidectomy and BMI.

Impact of bedside assistant on outcomes of robotic thyroid surgery: A STROBE-compliant retrospective case-control study

The importance of bedside assistants has been well established in various robotic procedures. However, the effect of assistants on the surgical outcomes of thyroid surgery remains unclear. We investigated the effects of a dedicated robot assistant (DRA) in robotic thyroidectomy. We also evaluated the learning curve of the DRA.Between January 2016 and December 2019, 191 patients underwent robotic total thyroidectomy, all of which were performed by a single surgeon. The DRA participated in 93 cases, while non-dedicated assistants (NRAs) helped with 98 cases. Demographic data, pathologic data, operative times, and postoperative complications were recorded and analyzed.Robotic thyroidectomy was successful in all 191 patients, and none required conversion to the conventional open procedure. Mean operative time was shorter in the DRA group than in the NRA group (183.2 ± 33.6 minutes vs 203.1 ± 37.9 minutes; P < .001). There were no significant differences in terms of sex distribution, age, preoperative serum thyroid stimulating hormone level, or pathologic characteristics between the groups. Cumulative summation analysis showed that it took 36 cases for the DRA to significantly reduce operative time. Mean operative time decreased significantly in the subgroup including the 37th to the 93rd DRA cases compared with the subgroup including only the first 36 DRA cases (199.7 ± 37.3 minutes vs 172.8 ± 26.4 minutes; P < .001). NRA group showed no definite decrease of operation time, which indicated that the NRAs did not significantly deviate from the mean performance.Increased experience of the bedside assistant reduced operative times in the robotic thyroidectomy. Assistant training should be considered as a component of robotic surgery training programs.

Scoping Evidence Review on Training and Skills Assessment for Open Emergency Surgery

OBJECTIVE

Scope evidence on technical performance metrics for open emergency surgery. Identify surgical performance metrics and procedures used in trauma training courses.

DESIGN

Structured literature searches of electronic databases were conducted from January 2010 to December 2019 to identify systematic reviews of tools to measure surgical skills employed in vascular or trauma surgery evaluation and training.

SETTING AND PARTICIPANTS

Faculty of Shock Trauma Anesthesiology Research Center, University of Maryland School of Medicine, Uniformed Services University of Health Sciences, Bethesda, Maryland and Implementation Science, King's College, London.

RESULTS

The evidence from 21 systematic reviews including over 54,000 subjects enrolled into over 840 eligible studies, identified that the Objective Structured Assessment of Technical Skill was used for elective surgery not for emergency trauma and vascular control surgery procedures. The Individual Procedure Score (IPS), used to evaluate emergency trauma procedures performed before and after training, distinguished performance of residents from experts and practicing surgeons. IPS predicted surgeons who make critical errors and need remediation interventions. No metrics showed Kirkpatrick's Level 4 evidence of technical skills training benefit to emergency surgery outcomes.

CONCLUSIONS

Expert benchmarks, errors, complication rates, task completion time, task-specific checklists, global rating scales, Objective Structured Assessment of Technical Skills, and IPS were found to identify surgeons, at all levels of seniority, who are in need of remediation of technical skills for open surgical hemorrhage control. Large-scale, multicenter studies are needed to evaluate any benefit of trauma technical skills training on patient outcomes.

Influence of trends in hospital volume over time on patient outcomes for high-risk surgery

BACKGROUND

The "practice makes perfect" concept considers the more frequent a hospital performs a procedure, the better the outcome of the procedure. We aimed to study this concept by investigating whether patient outcomes improve in hospitals with a significantly increased volume of high-risk surgery over time and whether a learning effect existed at the individual hospital level.

METHODS

We included all patients who underwent one of 10 digestive, cardiovascular and orthopaedic procedures between 2010 and 2014 from the French nationwide hospitals database. For each procedure, we identified three groups of hospitals according to volume trend (increased, decreased, or no change). In-hospital mortality, reoperation, and unplanned hospital readmission within 30 days were compared between groups using Cox regressions, taking into account clustering of patients within hospitals and potential confounders. Individual hospital learning effect was investigated by considering the interaction between hospital groups and procedure year.

RESULTS

Over 5 years, 759,928 patients from 694 hospitals were analysed. Patients' mortality in hospitals with procedure volume increase or decrease over time did not clearly differ from those in hospitals with unchanged volume across the studied procedures (e.g., Hazard Ratios [95%] of 1.04 [0.93-1.17] and 1.08 [0.97-1.21] respectively for colectomy). Furthermore, patient outcomes did not improve or deteriorate in hospitals with increased or decreased volume of procedures over time (e.g., 1.01 [0.95-1.08] and 0.99 [0.92-1.05] respectively for colectomy).

CONCLUSIONS

Trend in hospital volume over time did not appear to influence patient outcomes based on real-world data.

TRIAL REGISTRATION

NCT02788331, June 2, 2016.

Efficacy of Trauma Surgery Technical Skills Training Courses

OBJECTIVE

Because open surgical skills training for trauma is limited in clinical practice, trauma skills training courses were developed to fill this gap, The aim of this report is to find supporting evidence for efficacy of these courses. The questions addressed are: What courses are available and is there robust evidence of benefit?

DESIGN

We performed a systematic review of the training course literature on open trauma surgery procedural skills courses for surgeons using Kirkpatrick's framework for evaluating complex educational interventions. Courses were identified using Pubmed, Google Scholar and other databases.

SETTING AND PARTICIPANTS

The review was carried out at the University of Maryland, Baltimore with input from civilian and military trauma surgeons, all of whom have taught and/or developed trauma skills courses.

RESULTS

We found 32 course reports that met search criteria, including 21 trauma-skills training courses. Courses were of variable duration, content, cost and scope. There were no prospective randomized clinical trials of course impact. Efficacy for most courses was with Kirkpatrick level 1 and 2 evidence of benefit by self-evaluations, and reporting small numbers of respondents. Few courses assessed skill retention with longitudinal data before and after training. Three courses, namely: Advanced Trauma Life Support (ATLS), Advanced Surgical Skills for Exposure in Trauma (ASSET) and Advanced Trauma Operative Management (ATOM) have Kirkpatrick's level 2-3 evidence for efficacy. Components of these 3 courses are included in several other courses, but many skills courses have little published evidence of training efficacy or skills retention durability.

CONCLUSIONS

Large variations in course content, duration, didactics, operative models, resource requirements and cost suggest that standardization of content, duration, and development of metrics for open surgery skills would be beneficial, as would translation into improved trauma patient outcomes. Surgeons at all levels of training and experience should participate in these trauma skills courses, because these procedures are rarely performed in routine clinical practice. Faculty running courses without evidence of training benefit should be encouraged to study outcomes to show their course improves technical skills and subsequently patient outcomes. Obtaining Kirkpatrick's level 3 and 4 evidence for benefits of ASSET, ATOM, ATLS and for other existing courses should be a high priority.

A Strategy for Risk-adjusted Ranking of Surgeons and Practices Based on Patient-reported Outcomes After Elective Lumbar Surgery

STUDY DESIGN

This study retrospectively analyzes prospectively collected data.

OBJECTIVE

The primary aim of this study is to present a scheme for patient-reported outcome (PRO)-based, risk-adjusted rankings of spine surgeons and sites that perform elective lumbar surgery, using the Quality and Outcomes Database (QOD).

SUMMARY OF BACKGROUND DATA

There is currently no means of determining which spine surgeons or centers are positive or negative outliers with respect to PROs for elective lumbar surgery. This is a critical gap as we move toward a value-based model of health care in which providers assume more accountability for the effectiveness of their treatments.

METHODS

Random effects regression models were fit for the following outcomes, with QOD site as a fixed effect but surgeon ID as a random effect: Oswestry Disability Index, EQ-5D, back pain and leg pain, and satisfaction. Hierarchical Bayesian models were also fit for each outcome, with QOD site as a random effect and surgeon as a nested random effect.

RESULTS

Our study cohort consists of 8834 patients who underwent surgery by 124 QOD surgeons, for the degenerative lumbar diseases. Nonoverlapping Bayesian credible intervals demonstrate that the variance attributed to QOD site was greater than the nested variance attributed to surgeon ID for the included PROs.

CONCLUSION

This study presents a novel strategy for the risk-adjusted, PRO-based ranking of spine surgeons and practices. This can help identify positive and negative outliers, thereby forming the basis for large-scale quality improvement. Assuming adequate coverage of baseline risk adjustment, the choice of surgeon matters when considering PROs after lumbar surgery; however, the choice of site appears to matter more.

LEVEL OF EVIDENCE

3.

Quantitative Assessment of the Learning Curve for Robotic Thyroid Surgery

With the increased utilization of robot thyroidectomy in recent years, surgical proficiency is the paramount consideration. However, there is no single perfect or ideal method for measuring surgical proficiency. In this study, we evaluated the learning curve of robotic thyroidectomy using various parameters. A total of 172 robotic total thyroidectomies were performed by a single surgeon between March 2014 and February 2018. Cumulative summation analysis revealed that it took 50 cases for the surgeon to significantly improve the operation time. Mean operation time was significantly shorter in the group that included the 51st to the 172nd case, than in the group that included only the first 50 cases (132.8 ± 27.7 min vs. 166.9 ± 29.5 min; p < 0.001). On the other hand, the surgeon was competent after the 75th case when postoperative transient hypoparathyroidism was used as the outcome measure. The incidence of hypoparathyroidism gradually decreased from 52.0%, for the first 75 cases, to 40.2% after the 76th case. These results indicated that the criteria used to assess proficiency greatly influenced the interpretation of the learning curve. Incorporation of the operation time, complications, and oncologic outcomes should be considered in learning curve assessment.

Systematic review of measurement tools to assess surgeons' intraoperative cognitive workload

BACKGROUND

Surgeons in the operating theatre deal constantly with high-demand tasks that require simultaneous processing of a large amount of information. In certain situations, high cognitive load occurs, which may impact negatively on a surgeon's performance. This systematic review aims to provide a comprehensive understanding of the different methods used to assess surgeons' cognitive load, and a critique of the reliability and validity of current assessment metrics.

METHODS

A search strategy encompassing MEDLINE, Embase, Web of Science, PsycINFO, ACM Digital Library, IEEE Xplore, PROSPERO and the Cochrane database was developed to identify peer-reviewed articles published from inception to November 2016. Quality was assessed by using the Medical Education Research Study Quality Instrument (MERSQI). A summary table was created to describe study design, setting, specialty, participants, cognitive load measures and MERSQI score.

RESULTS

Of 391 articles retrieved, 84 met the inclusion criteria, totalling 2053 unique participants. Most studies were carried out in a simulated setting (59 studies, 70 per cent). Sixty studies (71 per cent) used self-reporting methods, of which the NASA Task Load Index (NASA-TLX) was the most commonly applied tool (44 studies, 52 per cent). Heart rate variability analysis was the most used real-time method (11 studies, 13 per cent).

CONCLUSION

Self-report instruments are valuable when the aim is to assess the overall cognitive load in different surgical procedures and assess learning curves within competence-based surgical education. When the aim is to assess cognitive load related to specific operative stages, real-time tools should be used, as they allow capture of cognitive load fluctuation. A combination of both subjective and objective methods might provide optimal measurement of surgeons' cognition.

Evaluating Surgeon-Specific Performance for Endoscopic Sinus Surgery

Importance

Several identified factors have raised questions concerning the quality of care for endoscopic sinus surgery (ESS), including the presence of large geographic variation in the rates and extent of surgery, poorly defined indications, and lack of ESS-specific quality metrics. Combined with the risk of major complications, ESS represents a high-value target for quality improvement.

Objective

To evaluate differences in surgeon-specific performance for ESS using a risk-adjusted, 5-year ESS revision rate as a quality metric.

Design, Setting, and Participants

This retrospective study used a population-based administrative database to study adults (≥18 years of age) with chronic rhinosinusitis (CRS) who underwent primary ESS in Alberta, Canada, between March 1, 2007, and March 1, 2010. The study period ended in 2015 to provide 5 years of follow-up.

Interventions

Endoscopic sinus surgery for CRS.

Main Outcomes and Measures

Primary outcomes were the 5-year observed and risk-adjusted ESS revision rate. Logistic regression was used to develop a risk adjustment model for the primary outcome.

Results

A total of 43 individual surgeons performed primary ESS in 2168 patients with CRS. Within 5 years after the primary ESS procedure, 239 patients underwent revision ESS, and the mean crude 5-year ESS revision rate was 10.6% (range, 2.4%-28.6%). After applying the risk adjustment model and 95% CI to each surgeon, 7 surgeons (16%) had lower-than-expected performance and 2 surgeons (5%) had higher-than-expected performance. Three variables had significant associations with surgeon-specific, 5-year ESS revision rates: presence of nasal polyps (odds ratio [OR], 2.07; 95% CI, 1.59-2.70), more annual systemic corticosteroid courses (OR, 1.33; 95% CI, 1.19-1.48), and concurrent septoplasty (OR, 0.70; 95% CI, 0.55-0.89).

Conclusions and Relevance

Evaluating surgeon-specific performance for ESS may provide information to assist in quality improvement. Although most surgeons had comparable risk-adjusted, 5-year ESS revision rates, 16% of surgeons had lower-than-expected performance, indicating a potential to improve quality of care. Future studies are needed to evaluate more surgeon-specific variables and validate a risk adjustment model to provide appropriate feedback for quality improvement.

Initial Comparison of Resident and Attending Milestones Evaluations in Plastic Surgery

BACKGROUND

Graduate medical education has recently undergone a major archetypal shift toward competency-based evaluations of residents' performance. The implementation of the Milestones program by the Accreditation Council for Graduate Medical Education (ACGME) is a core component of the shift, designed to ensure uniformity in measuring residency knowledge using a series of specialty-specific achievements. This study evaluates the correlation between residents' self-evaluations and program directors' assessments of their performance.

METHODS

The study population comprised 12 plastic surgery residents, ranging from postgraduate year 1 to postgraduate year 6, enrolled in an integrated residency program at a single institution.

RESULTS

Overall, average attending scores were lower than average resident scores at all levels except postgraduate year 6. Correlation between resident and attending evaluations ranged from 0.417 to 0.957, with the correlation of average scores of Patient Care (0.854) and Medical Knowledge (0.816) Milestones significantly higher than those of professional skillsets (0.581). "Patient care, facial esthetics" was the Milestone with the lowest average scores from both groups. Residents scored themselves notably higher than their attendings' evaluations in Practice-based Learning and Improvement categories (+0.958) and notably lower in Medical Knowledge categories such as "Cosmetic Surgery, Trunk and Lower Extremities" (-0.375) and "Non-trauma hand" (-0.208). The total possible number of participants in this study was 12. The actual number of participants was 12 (100%).

CONCLUSIONS

The remarkable range of correlations suggests that expectations for performance standards may vary widely between residents and program directors. Understanding gaps between expectations and performance is vital to inform current and future residents as the restructuring of the accreditation process continues.

Systematic review and a meta-analysis of hospital and surgeon volume/outcome relationships in colorectal cancer surgery

BACKGROUND

Numerous hospitals worldwide are considering setting minimum volume standards for colorectal surgery. This study aims to examine the association between hospital and surgeon volume on outcomes for colorectal surgery.

METHODS

Two investigators independently reviewed six databases from inception to May 2016 for articles that reported outcomes according to hospital and/or surgeon volume. Eligible studies included those in which assessed the association hospital or surgeon volume with outcomes for the surgical treatment of colon and/or rectal cancer. Random effects models were used to pool the hazard ratios (HRs) for the association between hospital/surgeon volume with outcomes.

RESULTS

There were 47 articles pooled (1,122,303 patients, 9,877 hospitals and 9,649 surgeons). The meta-analysis demonstrated that there is a volume-outcome relationship that favours high volume facilities and high volume surgeons. Higher hospital and surgeon volume resulted in reduced 30-day mortality (HR: 0.83; 95% CI: 0.78-0.87, P<0.001 & HR: 0.84; 95% CI: 0.80-0.89, P<0.001 respectively) and intra-operative mortality (HR: 0.82; 95% CI: 0.76-0.86, P<0.001 & HR: 0.50; 95% CI: 0.40-0.62, P<0.001 respectively). Post-operative complication rates depended on hospital volume (HR: 0.89; 95% CI: 0.81-0.98, P<0.05), but not surgeon volume except with respect to anastomotic leak (HR: 0.59; 95% CI: 0.37-0.94, P<0.01). High volume surgeons are associated with greater 5-year survival and greater lymph node retrieval, whilst reducing recurrence rates, operative time, length of stay and cost. The best outcomes occur in high volume hospitals with high volume surgeons, followed by low volume hospitals with high volume surgeons.

CONCLUSIONS

High volume by surgeon and high volume by hospital are associated with better outcomes for colorectal cancer surgery. However, this relationship is non-linear with no clear threshold of effect being identified and an apparent ceiling of effect.

Surgeon-Specific Reports in General Surgery: Establishing Benchmarks for Peer Comparison Within a Single Hospital

BACKGROUND

Methods to assess a surgeon's individual performance based on clinically meaningful outcomes have not been fully developed, due to small numbers of adverse outcomes and wide variation in case volumes. The Achievable Benchmark of Care (ABC) method addresses these issues by identifying benchmark-setting surgeons with high levels of performance and greater case volumes. This method was used to help surgeons compare their surgical practice to that of their peers by using merged National Surgical Quality Improvement Program (NSQIP) and Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program (MBSAQIP) data to generate surgeon-specific reports.

STUDY DESIGN

A retrospective cohort study at a single institution's department of surgery was conducted involving 107 surgeons (8,660 cases) over 5.5 years. Stratification of more than 32,000 CPT codes into 16 CPT clusters served as the risk adjustment. Thirty-day outcomes of interest included surgical site infection (SSI), acute kidney injury (AKI), and mortality. Performance characteristics of the ABC method were explored by examining how many surgeons were identified as benchmark-setters in view of volume and outcome rates within CPT clusters.

RESULTS

For the data captured, most surgeons performed cases spanning a median of 5 CPT clusters (range 1 to 15 clusters), with a median of 26 cases (range 1 to 776 cases) and a median of 2.8 years (range 0 to 5.5 years). The highest volume surgeon for that CPT cluster set the benchmark for 6 of 16 CPT clusters for SSIs, 8 of 16 CPT clusters for AKIs, and 9 of 16 CPT clusters for mortality.

CONCLUSIONS

The ABC method appears to be a sound and useful approach to identifying benchmark-setting surgeons within a single institution. Such surgeons may be able to help their peers improve their performance.