Macro vs Micro Level Surgical Quality Improvement: A Regional Collaborative Demonstrates the Case for a National NSQIP Initiative

The association between participation in the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) and postoperative outcomes: A comprehensive analysis of 7,474,298 patients

INTRODUCTION

Prior publications about the association between participation in the American College of Surgeons National Surgical Quality Improvement Program and improved postoperative outcomes have reported mixed results. We aimed to perform a comprehensive analysis of preoperative characteristics and unadjusted and risk-adjusted postoperative complication rates over time in the American College of Surgeons National Surgical Quality Improvement Program dataset.

METHODS

We used the American College of Surgeons National Surgical Quality Improvement Program database, 2005 to 2018, to analyze preoperative patient characteristics and unadjusted and risk-adjusted rates of adverse postoperative outcomes by year. Expected events were calculated using multiple logistic regression, with each complication as the dependent variable and the 28 non-laboratory preoperative American College of Surgeons National Surgical Quality Improvement Program variables as the independent variables. Annual observed-to-expected ratios for each outcome were used to risk-adjust outcomes over time.

RESULTS

The analytic cohort included 7,474,298 operations across 9 surgical specialties. Both the preoperative patient risk and the unadjusted rate of postoperative complications decreased over time. While the observed-to-expected ratio for mortality remained around 1, the observed-to-expected ratios for the other outcomes decreased over time from 2005 to 2018, except for the following cardiac complications: overall morbidity 1.11 (95% confidence interval: 1.10-1.13) to 0.97 (0.96-0.98); pulmonary 1.18 (1.15-1.21) to 0.91 (0.89-0.92); infection 1.19 (1.16-1.21) to 1.01 (1.00-1.01); urinary tract infection 1.29 (1.23-1.34) to 0.87 (0.86-0.89); venous thromboembolism 1.10 (1.03-1.16) to 0.92 (0.90-0.94) ; cardiac 0.76 (0.70-0.81) to 1.04 (1.01-1.07); renal 1.14 (1.08-1.21) to 0.96 (0.93-0.99); stroke 1.12 (1.00-1.25) to 0.98 (0.94-1.03); and bleeding 1.35 (1.33-1.36) to 0.80 (0.79-0.81).

CONCLUSION

Hospitals participating in the American College of Surgeons National Surgical Quality Improvement Program have experienced a decrease in risk-adjusted postoperative surgical complications over time in all areas except for mortality and cardiac complications.

The contribution of benchmarking to quality improvement in healthcare. A systematic literature review

BACKGROUND

Benchmarking has been recognised as a valuable method to help identify strengths and weaknesses at all levels of the healthcare system. Despite a growing interest in the practice and study of benchmarking, its contribution to quality of care have not been well elucidated. As such, we conducted a systematic literature review with the aim of synthesizing the evidence regarding the relationship between benchmarking and quality improvement. We also sought to provide evidence on the associated strategies that can be used to further stimulate quality improvement.

METHODS

We searched three databases (PubMed, Web of Science and Scopus) for articles studying the impact of benchmarking on quality of care (processes and outcomes). Following assessment of the articles for inclusion, we conducted data analysis, quality assessment and critical synthesis according to the PRISMA guidelines for systematic literature review.

RESULTS

A total of 17 articles were identified. All studies reported a positive association between the use of benchmarking and quality improvement in terms of processes (N = 10), outcomes (N = 13) or both (N = 7). In the majority of studies (N = 12), at least one intervention, complementary to benchmarking, was undertaken to stimulate quality improvement. The interventions ranged from meetings between participants to quality improvement plans and financial incentives. A combination of multiple interventions was present in over half of the studies (N = 10).

CONCLUSIONS

The results generated from this review suggest that the practice of benchmarking in healthcare is a growing field, and more research is needed to better understand its effects on quality improvement. Furthermore, our findings indicate that benchmarking may stimulate quality improvement, and that interventions, complementary to benchmarking, seem to reinforce this improvement. Although this study points towards the benefit of combining performance measurement with interventions in terms of quality, future research should further analyse the impact of these interventions individually.

A Collaborative To Evaluate And Improve The Quality Of Surgical Care Delivered By The Military Health System

In an effort to improve surgical quality and reduce clinical variability, the Military Health System (MHS) expanded its participation in the National Surgical Quality Improvement Program to all military hospitals beginning in 2015. This expansion and a partnership with the American College of Surgeons laid the foundation for a surgical quality collaborative in the MHS. We review the history of the program in the MHS and the activities that have contributed to developing the collaborative. We also report promising trends in surgical outcomes at hospitals that were already participating in the program in 2014, when a critical MHS review identified areas for improvement in surgical care. We conclude with a discussion of possible lessons for other health systems and challenges ahead for the MHS, now that full enrollment in the program has been completed.

The return of investment of hospital-based surgical quality improvement programs in reducing surgical site infection at a Canadian tertiary-care hospital

Objective

We performed a return-on-investment analysis comparing the investment in surgical site infection (SSI) prevention programs in a hospital setting to the savings from averted SSI cases.

Design

A retrospective case costing study using aggregated patient data to determine the incidence and costs of SSI infection in surgical departments over time. We calculated return on investment to the hospital and conducted several sensitivity and scenario analyses.

Setting

Data were compiled for the Ottawa Hospital (TOH), a Canadian tertiary-care teaching institution.

Patients

We used aggregated records for all hospital patients who underwent surgical procedures between April 2010 and January 2015.

Intervention

We estimated the potential cost savings of the hospital’s surgical quality improvement program, namely the Surgeons National Surgical Quality Improvement Program (NSQIP) and the Comprehensive Unit-based Safety Program (CUSP).

Results

From 2010 to 2016, TOH invested C$826,882 (US$624,384) in surgical quality improvement programs targeting SSI incidence and accrued C$1,885,110 (US$1,423,460) in cumulative savings from averted SSI cases, generating a return of $2.28 (US$3.02) per dollar invested (95% confidence interval [CI], −0.67 to 7.37). The study findings are sensitive to the estimated cost to the hospital per SSI case and the rate reduction attributable to the prevention program.

Conclusions

The NSQIP and CUSP have produced a positive return on investment at TOH; however, the result rests on several assumptions. This positive return on investment is expected to continue if the hospital can continue to reduce SSI incidence at least 0.25% annually without new investments. Findings from this study highlight the need for continuous program evaluation of the quality improvement initiatives.

Accelerating surgical quality improvement in Ontario through a regional collaborative: a quality-improvement study

BACKGROUND

The American College of Surgeons National Surgical Quality Improvement Program (NSQIP) collaborative in Ontario, the Ontario Surgical Quality Improvement Network (ON-SQIN), was launched in January 2015. We describe its approaches to support surgical quality improvement and examine its early impact on member hospitals.

METHODS

All Ontario hospitals that participated in the ON-SQIN and NSQIP were included in this quality-improvement study. The primary intervention was the introduction of the ON-SQIN, and the secondary interventions included a community of practice and access to quality-improvement resources and tools. Outcome measures included the level of quality-improvement capacity, collaborative-wide aggregate data on postoperative complications, and self-reported rates of surgical site and urinary tract infections.

RESULTS

Eighteen hospitals that enrolled in the ON-SQIN in 2015 reported an increase in their capacity for quality improvement after 18 months. Analysis of the collaborative-wide aggregate data in a 6-month period (14 748 surgical cases) revealed a substantial reduction of acute renal failure (relative risk 0.48, 95% confidence interval 0.25-0.95) and urinary tract infection (relative risk 0.77, 95% confidence interval 0.61-0.97). Most hospitals that targeted prevention of surgical site infection and urinary tract infection reported reduction of these occurrences during a 1-year period.

INTERPRETATION

The ON-SQIN supported the uptake of the NSQIP in Ontario hospitals and promoted targeted surgical quality-improvement initiatives, resulting in increased quality-improvement capacity and development of the community of practice. Furthermore, our early experience suggests that improvements in surgical care are being realized.

National Surgical Quality Improvement Program integration with Morbidity and Mortality conference is essential to success in the march to zero

BACKGROUND

Morbidity and Mortality conference (M&M) and the National Surgical Quality Improvement Program (NSQIP) are systems to improve surgical care. We evaluated the commonality of adverse events (AEs) and the change in AE rates after integration.

METHODS

A single institution's NSQIP and M&M registries were analyzed to determine commonality of AE reported. Causal determinant groups were then created to categorize and standardize AE. Incidence of AE and patient commonality identified by these systems was evaluated over 2 years.

RESULTS

The 68 common patients identified in 2012 represented 27% of NSQIP and 43% of M&M patients. Common AE reported by M&M and NSQIP decreased from 16.9% (2013) to 9.6% (2014). Causality code analysis demonstrated significant differences in proportion of issues addressed within each (P < .0001).

CONCLUSIONS

Despite standardized coding, M&M focus differed from NSQIP. Low commonality affirms NSQIP as a critical adjunct to voluntary reporting. Combining both may help eliminate preventable AEs.

Restating Surgical Risk: From Patient to Population

BACKGROUND

Recent federal legislation driving transition from fee-for-service to alternative methods of payment makes risk recognition essential for determination of appropriate payment systems. Because negotiations will include bundled population cohorts, we compared risk and results of an urban safety net teaching hospital's surgical population with state and national cohorts.

STUDY DESIGN

Deidentified summary data for 2013 and 2014 were analyzed to compare the safety net teaching hospital with a statewide collaborative and a national cohort from similar academic centers. Incidence of preoperative risk factors were compared, identifying those that were >50% higher than both state and national experiences. These were compared for change in incidence between years. Outcomes were evaluated by 30-day mortality, readmissions, return to operating room, length of stay, and adverse events incidence.

RESULTS

For both years, incidence of smoking, ventilator dependence, and CHF within 30 days was >50% higher than in the state and national cohorts. In 2014, septic shock was added to this, along with increased diabetes (14.3% to 19.8%), CHF (1.9% to 2.8%), and hypertension (39.9% to 52.5%). Despite these changes, 30-day mortality, return to operating room, length of stay, and readmissions were within ±5% of state and national results. Unplanned intubation, ventilation longer than 48 hours, and acute renal failure were 10th decile outliers. Median and interquartile range for length of stay were similar for all 3 populations across both years.

CONCLUSIONS

The incidence of comorbid conditions defines greater risk in this safety net teaching hospital population. Increased smoking-related pathology reflects local population disease burden, and increased ventilator support defines additional cost for this care. As disease-, procedure-, or population-based payment alternatives evolve, risk recognition, reduction, and resolution will be essential for determination of cost-efficient, optimal, surgical outcomes.

Collaborative quality improvement in surgery

Collaborative quality improvement has demonstrated success in improving quality and reducing health care costs in several state-based examples. Professional societies and payers are keen on identifying the most effective strategies to improve the safety and efficiency of surgical care. This review highlights the development and features of collaborative quality improvement programs, their advantages and examples of successful collaborations for several surgical conditions, and their potential application for surgeons caring for patients with upper extremity trauma and disability.