Florida Initiative for Quality Cancer Care: improvements in breast cancer quality indicators during a 3-year interval

Quality indicators in surgical oncology: systematic review of measures used to compare quality across hospitals

BACKGROUND

Measurement and reporting of quality indicators at the hospital level has been shown to improve outcomes and support patient choice. Although there are many studies validating individual quality indicators, there has been no systematic approach to understanding what quality indicators exist for surgical oncology and no standardization for their use. The aim of this study was to review quality indicators used to assess variation in quality in surgical oncology care across hospitals or regions. It also sought to describe the aims of these studies and what, if any, feedback was offered to the analysed groups.

METHODS

A literature search was performed to identify studies published between 1 January 2000 and 23 October 2023 that applied surgical quality indicators to detect variation in cancer care at the hospital or regional level.

RESULTS

A total of 89 studies assessed 91 unique quality indicators that fell into the following Donabedian domains: process indicators (58; 64%); outcome indicators (26; 29%); structure indicators (6; 7%); and structure and outcome indicators (1; 1%). Purposes of evaluating variation included: identifying outliers (43; 48%); comparing centres with a benchmark (14; 16%); and supplying evidence of practice variation (29; 33%). Only 23 studies (26%) reported providing the results of their analyses back to those supplying data.

CONCLUSION

Comparisons of quality in surgical oncology within and among hospitals and regions have been undertaken in high-income countries. Quality indicators tended to be process measures and reporting focused on identifying outlying hospitals. Few studies offered feedback to data suppliers.

Quality indicators for systemic anticancer therapy services: a systematic review of metrics used to compare quality across healthcare facilities

PURPOSE

The number of systemic anticancer therapy (SACT) regimens has expanded rapidly over the last decade. There is a need to ensure quality of SACT delivery across cancer services and systems in different resource settings to reduce morbidity, mortality, and detrimental economic impact at individual and systems level. Existing literature on SACT focuses on treatment efficacy with few studies on quality or how SACT is delivered within routine care in comparison to radiation and surgical oncology.

METHODS

Systematic review was conducted following PRISMA guidelines. EMBASE and MEDLINE were searched and handsearching was undertaken to identify literature on existing quality indicators (QIs) that detect meaningful variations in the quality of SACT delivery across different healthcare facilities, regions, or countries. Data extraction was undertaken by two independent reviewers.

RESULTS

This review identified 63 distinct QIs from 15 papers. The majority were process QIs (n = 55, 87.3%) relating to appropriateness of treatment and guideline adherence (n = 28, 44.4%). There were few outcome QIs (n = 7, 11.1%) and only one structural QI (n = 1, 1.6%). Included studies solely focused on breast, colorectal, lung, and skin cancer. All but one studies were conducted in high-income countries.

CONCLUSIONS

The results of this review highlight a significant lack of research on SACT QIs particularly those appropriate for resource-constrained settings in low- and middle-income countries. This review should form the basis for future work in transforming performance measurement of SACT provision, through context-specific QI SACT development, validation, and implementation.

Development of a natural language processing model for deriving breast cancer quality indicators : A cross-sectional, multicenter study

OBJECTIVES

Medico-administrative data are promising to automate the calculation of Healthcare Quality and Safety Indicators. Nevertheless, not all relevant indicators can be calculated with this data alone. Our feasibility study objective is to analyze 1) the availability of data sources; 2) the availability of each indicator elementary variables, and 3) to apply natural language processing to automatically retrieve such information.

METHOD

We performed a multicenter cross-sectional observational feasibility study on the clinical data warehouse of Assistance Publique - Hôpitaux de Paris (AP-HP). We studied the management of breast cancer patients treated at AP-HP between January 2019 and June 2021, and the quality indicators published by the European Society of Breast Cancer Specialist, using claims data from the Programme de Médicalisation du Système d'Information (PMSI) and pathology reports. For each indicator, we calculated the number (%) of patients for whom all necessary data sources were available, and the number (%) of patients for whom all elementary variables were available in the sources, and for whom the related HQSI was computable. To extract useful data from the free text reports, we developed and validated dedicated rule-based algorithms, whose performance metrics were assessed with recall, precision, and f1-score.

RESULTS

Out of 5785 female patients diagnosed with a breast cancer (60.9 years, IQR [50.0-71.9]), 5,147 (89.0%) had procedures related to breast cancer recorded in the PMSI, and 3732 (72.5%) had at least one surgery. Out of the 34 key indicators, 9 could be calculated with the PMSI alone, and 6 others became so using the data from pathology reports. Ten elementary variables were needed to calculate the 6 indicators combining the PMSI and pathology reports. The necessary sources were available for 58.8% to 94.6% of patients, depending on the indicators. The extraction algorithms developed had an average accuracy of 76.5% (min-max [32.7%-93.3%]), an average precision of 77.7% [10.0%-97.4%] and an average sensitivity of 71.6% [2.8% to 100.0%]. Once these algorithms applied, the variables needed to calculate the indicators were extracted for 2% to 88% of patients, depending on the indicators.

DISCUSSION

The availability of medical reports in the electronic health records, of the elementary variables within the reports, and the performance of the extraction algorithms limit the population for which the indicators can be calculated.

CONCLUSIONS

The automated calculation of quality indicators from electronic health records is a prospect that comes up against many practical obstacles.

Grading variation in 2,934 patients with ductal carcinoma in situ of the breast: the effect of laboratory- and pathologist-specific feedback reports

BACKGROUND

Histologic grade of ductal carcinoma in situ of the breast (DCIS) may become the single biomarker that decides whether patients will be treated. Yet, evidence shows that grading variation in daily practice is substantial. To facilitate quality improvement, feedback reports, in which laboratory-specific case-mix adjusted proportions per grade were benchmarked against other laboratories, were sent to the individual laboratories by March 1, 2018. One year later, the effect of these feedback reports on inter-laboratory variation was studied.

METHODS

Synoptic pathology reports of all pure DCIS resection specimens between March 1, 2017 and March 1, 2019 were retrieved from PALGA (the nationwide Dutch pathology registry). Laboratory-specific proportions per grade were compared to the overall proportion in the year before and after feedback. The absolute deviation for all three grades at once, represented by the overall deviation score (ODS), was calculated as the sum of deviations from the grade-specific overall proportions. Case-mix adjusted, laboratory-specific odds ratios (ORs) for high- (grade III) versus low-grade (grade I-II) DCIS were obtained by multivariable logistic regression.

RESULTS

Overall, 2954 DCIS reports from 31 laboratories were included. After feedback, the range between laboratories decreased by 22 and 6.5% for grades II and III, while an increase of 6.2% was observed for grade I. Both the mean ODS (27.2 to 24.1%) and maximum ODS (87.7 to 59.6%) decreased considerably. However, the range of case-mix adjusted ORs remained fairly stable and substantial (0.39 (95% CI: 0.18-0.86) to 3.69 (95% CI: 1.30-10.51)).

CONCLUSION

A promising decrease in grading variation was observed after laboratory-specific feedback for DCIS grades II-III, while this was not observed for DCIS grade I. Overall, grading variation remained substantial which needs to be addressed considering its clinical implications. Nationwide consensus on a classification, and training of (expert breast) pathologists, for example by e-learning, may help to further improve grading standardization.

Variation in breast cancer grading: the effect of creating awareness through laboratory-specific and pathologist-specific feedback reports in 16 734 patients with breast cancer

AIMS

Histological grade is widely used to guide the management of invasive breast cancer (IBC). Yet, substantial interlaboratory and intralaboratory grading variations exist in daily pathology practice. To create awareness and to facilitate quality improvement, feedback reports, containing case-mix-adjusted laboratory-specific grades benchmarked against other laboratories, were sent to the individual laboratories by 1 March 2018. We studied the effect of these feedback reports on interlaboratory grading variation up till 1 year later.

METHODS

Overall, 17 102 synoptic pathology reports of IBC resection specimens from 33 laboratories, obtained between 1 March 2017 and 1 March 2019 were retrieved from the Dutch Pathology Registry (PALGA). An overall deviation score (ODS), representing the sum of deviations from the grade-specific overall proportions, was calculated to compare the absolute deviation for all grades at once. Case-mix correction was performed by two multivariable logistic regression analyses, providing laboratory-specific ORs for high-grade versus low-grade IBC.

RESULTS

After feedback, the overall range between laboratories decreased by 3.8%, 6.4% and 6.6% for grades I, II and III, respectively. Though the mean ODS remained similar (13.8% vs 13.7%), the maximum ODS decreased from 34.1% to 29.4%. The range of laboratory-specific ORs decreased by 21.9% for grade III versus grades I-II.

CONCLUSIONS

An encouraging decrease in grading variation of IBC was observed after laboratory-specific feedback. Nevertheless, the overall grading variation remains substantial. In view of the important role of grading in patient management, it is adamant that not only feedback should be provided on a regular basis but also other interventions, such as additional training, are required.

The I COUGH Multidisciplinary Perioperative Pulmonary Care Program: One Decade of Experience

BACKGROUND

Surgical quality improvement programs can provide meaningful benefits for patient outcomes, but sustainability of initial success is rarely described. In response to data that revealed a greater than predicted likelihood of postoperative pulmonary complications in one hospital, the study team designed a standardized program to improve care. This study offers a long-term perspective of the effort, including special challenges and lessons learned about sustaining success.

METHODS

A before-after study was conducted at an academic safety-net hospital. A multidisciplinary team developed tactics to reduce pulmonary complications, designated by the acronym I COUGH: Incentive spirometry, Coughing/deep breathing, Oral care, Understanding (education), Getting out of bed, and Head of bed elevation. Clinical practices were audited and compared to actual and risk-adjusted pulmonary outcomes.

RESULTS

Improvements in compliance with the I COUGH elements were initially promising, but baseline behaviors eventually returned. Adverse outcomes have inversely correlated with process adherence in "sawtooth" patterns. Rejuvenation efforts have successively extended beyond the literal principles of the acronym to foster broader institutional commitment to perioperative pulmonary care, restoring favorable trends in both process and outcomes. A more comprehensive I COUGH program now extends beyond the acronym, applying numerous concepts to support the original program.

CONCLUSION

I COUGH, a standardized perioperative pulmonary care program, initially improved performance and reduced pulmonary complications. However, loss of early program momentum corresponded with a return to baseline outcomes. Fortunately, an overall favorable trend has resulted from a coordinated rededication to I COUGH that requires steadfast commitment and creative responses to numerous cultural barriers.

Compliance with clinical guidelines for breast cancer management: A population-based study of quality-of-care indicators in France

Background

The European Society of Breast Cancer Specialists (EUSOMA), which aims to standardize the quality of patient care in Europe, has defined quality indicators (QIs) for breast cancer (BC) care to assess compliance to current care standards. These QIs are a useful tool to evaluate care organizations. Only population-based studies are able to assess health system performance in “real-life” situations. This population-based study aimed to describe compliance with several EUSOMA QIs overall and according to patient and organizational factors in France.

Methods

1 560 adult women with primary invasive non-metastatic BC diagnosed in 2012 were randomly selected among all incident BC from 16 French geographical areas covered by cancer registries. Twelve EUSOMA QIs were selected regarding diagnosis, treatment and staging.

Results

The minimum standard as proposed by EUSOMA was met for nine QIs related to pre-operative definitive diagnosis, multidisciplinary discussion and treatment (single surgery, breast conserving surgery (BCS) for small BC (<3cm), radiotherapy after BCS or mastectomy for regional BC (pN≥2a), hormonotherapy, adjuvant chemotherapy and trastuzumab). Low compliance was observed for sentinel lymph node biopsy (SLNB) and staging imaging. Adherence to guidelines was usually lower in older patients and in patients with comorbidities. Multidisciplinary discussion was positively related to adherence to guidelines for diagnosis, staging practices (SNLB, imaging) and systemic treatments. Compliance also varied by area of residence and by place of first treatment.

Conclusion

This study provides the first current, comprehensive overview of BC quality care at a population level in France. The guidelines were correctly applied in percentage satisfying the EUSOMA standards for the diagnosis and treatment of BC, although staging practices (SLNB, imaging) can be improved. These results highlight the need for continuous measurement of adherence to guidelines to improve BC care.

Longitudinal cohort study to determine effectiveness of a novel simulated case and feedback system to improve clinical pathway adherence in breast, lung and GI cancers

OBJECTIVES

This study examined whether a measurement and feedback system led to improvements in adherence to clinical pathways.

DESIGN

The M-QURE (Moffitt-Quality, Understanding, Research and Evidence) Initiative was introduced in 2012 to enhance and improve adherence to pathways at Moffitt Cancer Center (MCC) in three broad clinical areas: breast, lung and gastrointestinal (GI) cancers. M-QURE used simulated patient vignettes based on MCC's Clinical Pathways to benchmark clinician adherence and monitor change over three rounds of implementation.

SETTING

MCC, located in Tampa, Florida, a National Cancer Institute Comprehensive Cancer Center.

PARTICIPANTS

Three non-overlapping cohorts at MCC (one each in breast, lung and GI) totalling 48 providers participated in this study, with each member of the multidisciplinary team (composed of medical oncologists, radiation oncologists, surgeons and advanced practice providers) invited to participate.

INTERVENTIONS

Each participant was asked to complete a set of simulated patient vignettes over three rounds within their own cancer specialty. Participants were required to complete all assigned vignettes over each of the three rounds, or they would be excluded from this study.

PRIMARY OUTCOME MEASURE

Increased domain and overall provider care adherence to clinical pathways, as scored by blinded physician abstractors.

RESULTS

We found significant improvements in pathway adherence between the third and first rounds of data collection particularly for workup and treatment of cancer cases. By clinical grouping, breast improved by 13.6% (p<0.001), and lung improved by 12.1% (p<0.001) over baseline, whereas GI showed a decrease of 1.4% (p=0.68).

CONCLUSIONS

Clinical pathway adherence improved in a short timeframe for breast and lung cancers using group-level measurement and individual feedback. This suggests that a measurement and feedback programme may be a useful tool to improve clinical pathway adherence.

Menopausal status does not predict Oncotype DX recurrence score

BACKGROUND

Adjuvant treatment for early stage, estrogen receptor (ER) positive invasive breast cancer has been based on prognosticators such as menopausal status. The recurrence score (RS) from the 21-gene assay Oncotype DX (ODX) is predictive of a 10-y distant recurrence in this population but is rarely applied to premenopausal patients. The relationship between menopausal status and RS was evaluated.

MATERIALS AND METHODS

An institutional review board-approved retrospective review was conducted of invasive breast cancer patients with known RS. ODX eligibility was based on National Comprehensive Cancer Network guidelines or physician discretion. Perimenopausal women were classified as premenopausal for statistical analyses. Comparisons of menopausal status and RS were made using general linear regression model and the exact Wilcoxon rank-sum test.

RESULTS

Menopausal status was available for 575 patients (142 premenopausal, 433 postmenopausal). Median age was 46 y for premenopausal and 62 y for postmenopausal. Median invasive tumor size was 1.5 cm for both cohorts. Mastectomy rate was higher in the premenopausal group (54.8%) than postmenopausal (42%; P = 0.0001). Premenopausal women had a higher local-regional recurrence rate (2.8% versus 0%; P = 0.0384) but distant recurrence and overall survival were not statistically different (P = 0.6808). Median ER H-score was lower in premenopausal (H-score = 270) than postmenopausal women (H-score = 280; P < 0.0001). Median RS was 16 for both premenopausal (range, 0-54) and postmenopausal (range, 0-63) women. Menopausal status as a categorical variable was not predictive of RS (P-value = 0.6780).

CONCLUSIONS

Menopausal status has limited predictive power for distant recurrence. Therefore, menopausal status alone should not preclude performance of ODX in ER-positive, early stage breast cancer.