Clinical auditing as an instrument to improve care for patients with ovarian cancer: The Dutch Gynecological Oncology Audit (DGOA)

Effect of surgical volume on short-term outcomes of cytoreductive surgery for advanced-stage ovarian cancer: A population-based study from the Dutch Gynecological Oncology Audit

OBJECTIVE

Despite lacking clinical data, the Dutch government is considering increasing the minimum annual surgical volume per center from twenty to fifty cytoreductive surgeries (CRS) for advanced-stage ovarian cancer (OC). This study aims to evaluate whether this increase is warranted.

METHODS

This population-based study included all CRS for FIGO-stage IIB-IVB OC registered in eighteen Dutch hospitals between 2019 and 2022. Short-term outcomes included result of CRS, length of stay, severe complications, 30-day mortality, time to adjuvant chemotherapy, and textbook outcome. Patients were stratified by annual volume: low-volume (nine hospitals, <25), medium-volume (four hospitals, 29-37), and high-volume (five hospitals, 54-84). Descriptive statistics and multilevel logistic regressions were used to assess the (case-mix adjusted) associations of surgical volume and outcomes.

RESULTS

A total of 1646 interval CRS (iCRS) and 789 primary CRS (pCRS) were included. No associations were found between surgical volume and different outcomes in the iCRS cohort. In the pCRS cohort, high-volume was associated with increased complete CRS rates (aOR 1.9, 95%-CI 1.2-3.1, p = 0.010). Furthermore, high-volume was associated with increased severe complication rates (aOR 2.3, 1.1-4.6, 95%-CI 1.3-4.2, p = 0.022) and prolonged length of stay (aOR 2.3, 95%-CI 1.3-4.2, p = 0.005). 30-day mortality, time to adjuvant chemotherapy, and textbook outcome were not associated with surgical volume in the pCRS cohort. Subgroup analyses (FIGO-stage IIIC-IVB) showed similar results. Various case-mix factors significantly impacted outcomes, warranting case-mix adjustment.

CONCLUSIONS

Our analyses do not support further centralization of iCRS for advanced-stage OC. High-volume was associated with higher complete pCRS, suggesting either a more accurate selection in these hospitals or a more aggressive approach. The higher completeness rates were at the expense of higher severe complications and prolonged admissions.

Quality of surgery and treatment and its association with hospital volume: A population-based study in more than 5000 Belgian ovarian cancer patients

BACKGROUND

Different sets of quality indicators are used to identify areas for improvement in ovarian cancer care. This study reports transparently on how (surgical) indicators were measured and on the association between hospital volume and indicator results in Belgium, a country setting without any centralisation of ovarian cancer care.

METHODS

From the population-based Belgian Cancer Registry, patients with a borderline malignant or invasive epithelial ovarian tumour diagnosed between 2014 and 2018 were selected and linked to health insurance and vital status data (n = 5119). Thirteen quality indicators on diagnosis and treatment were assessed and the association with hospital volume was analysed using logistic regression adjusted for case-mix.

RESULTS

The national results for most quality indicators on diagnosis and systemic therapy were around the predefined target value. Other indicators showed results below the benchmark: genetic testing, completeness of staging surgery, lymphadenectomy with at least 20 pelvic/para-aortic lymph nodes removed, and timely start of chemotherapy after surgery (within 42 days). Ovarian cancer care in Belgium is dispersed over 100 hospitals. Lower volume hospitals showed poorer indicator results compared to higher volume hospitals for lymphadenectomy, staging, timely start of chemotherapy and genetic testing. In addition, surgery for advanced stage tumours was performed less often in lower volume hospitals.

CONCLUSIONS

The indicators that showed poorer results on a national level were also those with poorer results in lower-volume hospitals compared to higher-volume hospitals, consequently supporting centralisation. International benchmarking is hampered by different (surgical) definitions between countries and studies.

Textbook outcome as a composite outcome measure to compare hospital performances regarding cytoreductive surgery for ovarian cancer: A nationwide population-based study

OBJECTIVE

Textbook outcome (TO) is a composite outcome measure used in surgical oncology to compare hospital outcomes using multiple quality indicators. This study aimed to develop TO as an outcome measure to assess healthcare quality for patients undergoing cytoreductive surgery (CRS) for advanced-stage ovarian cancer.

METHODS

This population-based study included all CRS for FIGO IIIC-IVB primary ovarian cancer registered in the Netherlands between 2017 and 2020. The primary outcome was TO, defined as a complete CRS, combined with the absence of 30-day mortality, severe complications, and prolonged length of admission (≥ten days). Delayed start of adjuvant chemotherapy (≥six weeks) was not included in TO because of missing data. Logistic regressions were used to assess the association of case-mix factors with TO. Hospital variation was displayed using funnel plots.

RESULTS

A total of 1909 CRS were included, of which 1434 were interval CRS and 475 were primary CRS. TO was achieved in 54% of the interval CRS cohort and 47% of the primary CRS cohort. Macroscopic residual disease after CRS was the most important factor for not achieving TO. Age ≥ 70 was associated with lower TO rates in multivariable logistic regressions. TO rates ranged from 40% to 69% between hospitals in the interval CRS cohort and 22% to 100% in the primary CRS cohort. In both analyses, one hospital had significantly lower TO rates (different hospitals). Case-mix adjustment significantly affected TO rates in the primary CRS analysis.

CONCLUSIONS

TO is a suitable composite outcome measure to detect hospital variation in healthcare quality for patients with advanced-stage ovarian cancer undergoing CRS. Case-mix adjustment improves the accuracy of the hospital comparison.

Between-Hospital and Between-Physician Variation in Outcomes and Costs in High- and Low-Complex Surgery: A Nationwide Multilevel Analysis

OBJECTIVES

Clinicians and policy makers are increasingly exploring strategies to reduce unwarranted variation in outcomes and costs. Adequately accounting for case mix and better insight into the levels at which variation exists is crucial for such strategies. This nationwide study investigates variation in surgical outcomes and costs at the level of hospitals and individual physicians and evaluates whether these can be reliably compared on performance.

METHODS

Variation was analyzed using 92 330 patient records collected from 62 Dutch hospitals who underwent surgery for colorectal cancer (n = 6640), urinary bladder cancer (n = 14 030), myocardial infarction (n = 31 870), or knee osteoarthritis (n = 39 790) in the period 2018 to 2019. Multilevel regression modeling with and without case-mix adjustment was used to partition variation in between-hospital and between-physician components for in-hospital mortality, intensive care unit admission, length of stay, 30-day readmission, 30-day reintervention, and in-hospital costs. Reliability was calculated for each treatment-outcome combination at both levels.

RESULTS

Across outcomes, hospital-level variation relative to total variation ranged between ≤ 1% and 15%, and given the high caseloads, this typically yielded high reliability (> 0.9). In contrast, physician-level variation components were typically ≤ 1%, with limited opportunities to make reliable comparisons. The impact of case-mix adjustment was limited, but nonnegligible.

CONCLUSIONS

It is not typically possible to make reliable comparisons among physicians due to limited partitioned variation and low caseloads. Nevertheless, for hospitals, the opposite often holds. Although variation-reduction efforts directed at hospitals are thus more likely to be successful, this should be approached cautiously, partly because level-specific variation and the impact of case mix vary considerably across treatments and outcomes.

Case-mix adjustment to compare hospital performances regarding complications after cytoreductive surgery for ovarian cancer: a nationwide population-based study

OBJECTIVE

Complication rates after cytoreductive surgery are important quality indicators for hospitals that treat patients with advanced-stage ovarian cancer. Case-mix factors are patient and tumor characteristics that may influence hospital outcomes such as the complication rates. Currently, no case-mix adjustment model exists for complications after cytoreductive surgery; therefore, it is unclear whether hospitals are being compared correctly. This study aims to develop the first case-mix adjustment model for complications after surgery for advanced-stage ovarian cancer, enabling an accurate comparison between hospitals.

METHODS

This population-based study included all patients undergoing cytoreductive surgery for advanced-stage ovarian cancer registered in the Netherlands in 2017-2019. Case-mix variables were identified and assessed using logistic regressions. The primary outcome was the composite outcome measure 'complicated course'. Patients had a complicated course when at least one of the following criteria were met: (1) any complication combined with a prolonged length of hospital stay; (2) complication requiring reintervention; (3) any complication with a prolonged length of stay in the intensive care unit; or (4) 30-day mortality or in-hospital mortality during admission following surgery. Inter-hospital variation was analyzed using univariable and multivariable logistic regressions and visualized using funnel plots.

RESULTS

A total of 1822 patients were included, of which 10.7% (n=195) had a complicated course. Comorbidity and tumor stage had a significant impact on complicated course rates in multivariable logistic regression. Inter-hospital variation was not significant for case-mix factors. Complicated course rates ranged between 2.2% and 29.1%, and case-mix adjusted observed/expected ratios ranged from 0.20 to 2.67 between hospitals. Three hospitals performed outside the confidence intervals for complicated course rates. These hospitals remained outliers after case-mix adjustment.

CONCLUSION

There is variation between hospitals regarding complicated course rates after cytoreductive surgery for ovarian cancer in the Netherlands. While comorbidity and tumor stage significantly affected the complicated course rates, adjusting for case-mix factors did not significantly affect hospital outcomes. The limited impact of case-mix adjustment could be a result of the Dutch centralized healthcare model.

Guideline adherence in ovarian cancer for surgical staging in the Netherlands

OBJECTIVE

Previous studies have shown low adherence to surgical staging guidelines in patients with clinical early-stage ovarian carcinoma. The aim of this study was to identify guideline adherence for surgical staging and to show the distribution of each surgical item within the study population. In addition, we examined whether regional variation in the Netherlands exists for complete surgical staging.

METHODS

Patients with ovarian cancer and surgical staging registered in the Dutch Gynecological Oncology Audit between January 1, 2015 and December 31, 2019 in the Netherlands were included. Complete surgical staging was defined according to the Dutch evidence-based guideline. Surgical items were ranked and illustrated. Variation in complete surgical staging for eight regional cancer networks was shown in funnel plots. Manual validation of registered data was performed in three gynecological oncology centers.

RESULTS

604 patients underwent surgical staging, 365 (60%) underwent an incomplete staging procedure, 295 (81%) were registered with early-stage disease (International Federation of Gynecology and Obstetrics I-IIA) and, of these patients, 115 (39%) received adjuvant chemotherapy. Patients with incomplete surgical staging were operated more often with minimal invasive techniques (laparoscopy or robot) compared with patients in the complete staging group (p<0.001). Sampling of cytology/ascites was the most frequently lacking factor (29%). Manual validation of data in three gynecological oncology centers identified reasons for incomplete staging, the most common being 'perioperative findings' such as dense adhesions between tumor and peritoneum, consistent with advanced stage disease (≥IIA). Regional variation for complete surgical staging showed two regions performing outside the confidence intervals (12.5% and 25.5%, mean 40%).

CONCLUSION

Guideline adherence for staging was lower than expected and validation of data gave additional insights into the reasons that were contributing to incomplete surgical staging. Moreover, this analysis showed that regional variation for surgical staging exists, which forms a starting point to improve and harmonize staging procedures for these patients nationwide.

Impact of the COVID-19-pandemic on patients with gynecological malignancies undergoing surgery: A Dutch population-based study using data from the 'Dutch Gynecological Oncology Audit'

OBJECTIVE

The COVID-19-pandemic caused drastic healthcare changes worldwide. To date, the impact of these changes on gynecological cancer healthcare is relatively unknown. This study aimed to assess the impact of the COVID-19-pandemic on surgical gynecological-oncology healthcare.

METHODS

This population-based cohort study included all surgical procedures with curative intent for gynecological malignancies, registered in the Dutch Gynecological Oncology Audit, in 2018-2020. Four periods were identified based on COVID-19 hospital admission rates: 'Pre-COVID-19', 'First wave', 'Interim period', and 'Second wave'. Surgical volume, perioperative care processes, and postoperative outcomes from 2020 were compared with 2018-2019.

RESULTS

A total of 11,488 surgical procedures were analyzed. For cervical cancer, surgical volume decreased by 17.2% in 2020 compared to 2018-2019 (mean 2018-2019: n = 542.5, 2020: n = 449). At nadir (interim period), only 51% of the expected cervical cancer procedures were performed. For ovarian, vulvar, and endometrial cancer, volumes remained stable. Patients with advanced-stage ovarian cancer more frequently received neoadjuvant chemotherapy in 2020 compared to 2018-2019 (67.7% (n = 432) vs. 61.8% (n = 783), p = 0.011). Median time to first treatment was significantly shorter in all four malignancies in 2020. For vulvar and endometrial cancer, the length of hospital stay was significantly shorter in 2020. No significant differences in complicated course and 30-day-mortality were observed.

CONCLUSIONS

The COVID-19-pandemic impacted surgical gynecological-oncology healthcare: in 2020, surgical volume for cervical cancer dropped considerably, waiting time was significantly shorter for all malignancies, while neoadjuvant chemotherapy administration for advanced-stage ovarian cancer increased. The safety of perioperative healthcare was not negatively impacted by the pandemic, as complications and 30-day-mortality remained stable.

Incomplete surgical staging in clinical early-stage ovarian cancer: guidelines versus daily practice

Background

Incomplete surgical staging of patients with early-stage epithelial ovarian cancer (EOC) has been reported in up to 98% of cases, when based on the International Federation of Obstetrics and Gynecology (FIGO) staging procedure. The aim of the present retrospective study was to clarify the reasons for incomplete staging.

Methods

The PRISMA (Prevention Recovery Information System for Monitoring and Analysis) technique was used to evaluate cases with FIGO I-IIa EOC based on incomplete staging from five gynecologic oncologic center hospitals in the Netherlands in the period 2010-2014.

Results

Fifty cases with an incomplete surgical staging of EOC according to national guidelines were included. The most common reasons for incomplete staging were insufficient random biopsies of the peritoneum (n = 34, 68%), and less than ten lymph nodes being resected and/or found at pathology (n = 16, 32%). The most mentioned reason for not performing biopsies was, besides forgetting to do so, believing that after careful inspection and palpation, taking biopsies is irrelevant and/or already are being taken while performing a hysterectomy (peritoneum of cul-de-sac, bladder). The value of contralateral pelvic lymph node dissection in case of a unilateral ovarian malignancy was also doubted, influencing the number of lymph nodes resected.

Conclusions

The most important reasons for incomplete staging in EOC are, besides omitting elements by accident, questioning the importance of obligatory elements of the staging procedure. A structured list of staging steps during surgery and more evidence-based consensus concerning these obligatory elements might increase the number of complete staging procedures in EOC.