Measuring and improving quality in university hospitals in Canada: The Collaborative for Excellence in Healthcare Quality

Hospital performance evaluation indicators: a scoping review

BACKGROUND

Hospitals are the biggest consumers of health system budgets and hence measuring hospital performance by quantitative or qualitative accessible and reliable indicators is crucial. This review aimed to categorize and present a set of indicators for evaluating overall hospital performance.

METHODS

We conducted a literature search across three databases, i.e., PubMed, Scopus, and Web of Science, using possible keyword combinations. We included studies that explored hospital performance evaluation indicators from different dimensions.

RESULTS

We included 91 English language studies published in the past 10 years. In total, 1161 indicators were extracted from the included studies. We classified the extracted indicators into 3 categories, 14 subcategories, 21 performance dimensions, and 110 main indicators. Finally, we presented a comprehensive set of indicators with regard to different performance dimensions and classified them based on what they indicate in the production process, i.e., input, process, output, outcome and impact.

CONCLUSION

The findings provide a comprehensive set of indicators at different levels that can be used for hospital performance evaluation. Future studies can be conducted to validate and apply these indicators in different contexts. It seems that, depending on the specific conditions of each country, an appropriate set of indicators can be selected from this comprehensive list of indicators for use in the performance evaluation of hospitals in different settings.

Multicentre positive deviance seminar to generate best practice recommendations to reduce anastomotic leak and length of stay for patients undergoing oesophagectomy

BACKGROUND

We describe a novel process using positive deviance (PD) with the Canadian Association of Thoracic Surgeons members, to identify perioperative best practice to minimise anastomotic leak (AL) and length of stay (LOS) following oesophagectomy. To our knowledge, this is the first National combination of level 1 evidence with expert opinion (ie, PD seminar) aimed at reducing AL and LOS in oesophageal surgery. Our primary hypothesis is that a multicentre National PD seminar is feasible, and could lead to the generation of best practices recommendations aimed at reducing AL and LOS in patients with oesophageal cancer.

METHODS

Adverse events, LOS and AL incidence/severity following oesophagectomy were prospectively collected from seven Canadian thoracic institutions using Thoracic Morbidity and Mortality classification system (2017-2020). Anonymised display of centre's data were presented, with identification of centres demonstrating PD. Surgeons from PD sites discussed principles of care, culminating in the consensus recommendations, anonymously rated by all (5-point Likert scale).

RESULTS

Data from 795 esophagectomies were included, with 25 surgeons participating. Two centres were identified as having the lowest AL rates 44/395 (11.1%) (vs five centres 71/400 (17.8%) (p<0.01)) and shortest LOS 8 days 45 (IQR: 6-14) (vs 10 days (IQR: 8-18) (p<0.001)). Recommendations included preoperative (prehabilitation, smoking cessation, chemotherapy for patients with dysphagia, minimise stents/feeding tubes), intraoperative (narrow gastric conduit, intrathoracic anastomosis, avoid routine jejunostomy, use small diameter closed-suction drains), postoperative day (POD) (early (POD 2-3) enteral feeding initiation, avoid routine barium swallow studies, early removal of tubes/drains (POD 2-3)). All ranked above 80% (4/5) in agreement to implement recommendations into their practice.

CONCLUSION

We report the feasibility of a National multicentre PD seminar with the generation of best practice recommendations aimed at reducing AL and LOS following oesophagectomy. Further research is required to demonstrate whether National PD seminars can be an effective quality improvement tool.

Multicentre positive deviance to reduce adverse events and length of stay after pulmonary resection

BACKGROUND

Postoperative adverse events (AEs) following pulmonary resection enormously impact patient well-being, length of stay (LOS) and healthcare costs. Standardised AE data collection can be used to identify positive outliers demonstrating positive deviance (PD) who may be helpful to inform the best practice. Here, we describe our initial experience of a novel quality improvement process using PD to reduce LOS and AEs.

METHODS

AE rates and LOS were collected from four centres (2014-2020) using a common dictionary. Surgeons repeatedly participated in 60 to 90 min seminars consisting of the following process: identify outcome and procedure targeted, review relevant best evidence literature, view all data anonymised by surgeon or centre (if multicentre), choose and reveal identity of best performance PD outliers, who discuss their management principles while all receive self-evaluation reports, followed by collegial discussion to generate consensus recommendations, voted by all. We assessed overall impact on AEs and LOS using aggregate data in a before/after analysis.

RESULTS

A total of 131 surgeons (average 12/seminar) participated in 11 PD seminars (8 local and 3 multicentre), yielding 85 consensus recommendation (average 8/seminar). Median LOS following lobectomy decreased from 4.0 to 3.0 days (p=0.04) following local PD seminars and from 4.0 to 3.5 days (p=0.11) following multicentre seminars. Trends for reductions in multiple AE rates were also observed.

CONCLUSION

While limited by the longitudinal design, these findings provide preliminary support for this data-driven, collegial and actionable quality improvement process to help standardise and improve patient care, and merits further more rigorous investigation.

Measuring and Improving Patient Safety in Canada

Patients, families, and care providers affected by patient safety incidents expect there will be learning and improvement so that others will not suffer. For that, countries need mature data systems and a culture of safety that includes improving by learning from reporting hazards, harm, and near misses, as well as learning from situations and organizations where safe care is delivered consistently over time, which is in most cases. While systems are in place to support incident reporting, sharing, and learning from a variety of sources, in Canada truly national incident reporting is limited to medications, adverse drug reactions, and device failures. However, there are other pan-Canadian and grassroots efforts to advance reporting and learning from patient safety incidents that are complementary. System and contextual factors influence the ability to improve safety, learn, and report. An important one is the COVID-19 pandemic, which resulted in limited or delayed patient safety reporting and some scaling back of improvement projects. The best systems incorporate reporting from multiple sources (patient feedback, coroner reports, etc.) and engage all people involved in care, especially patients and families, in their design, implementation, and continuous improvement. Patient groups, like Patients for Patient Safety Canada (PFPSC), provide the perspective of patients and families with lived experiences that can effectively improve safety. PFPSC contributes to the development of Canadian patient safety strategies, policies, and programs, and innovates and co-leads initiatives that matter to patients and the public. The World Health Organization’s Global Patient Safety Action Plan includes patient safety incident reporting and learning systems to “ensure a constant flow of information and knowledge to drive the mitigation of risk, a reduction in levels of avoidable harm, and improvements in the safety of care” objective.

Dimensions of performance and related key performance indicators addressed in healthcare organisations: A literature review

INTRODUCTION

Performance measurement systems have become essential managerial tools for healthcare organisations in the last few decades. They allow hospital managers to pilot their institution and assess the development of the organisation in helping managers in decision-making and viewing the different impacts of these decisions. However, there is a need to investigate further the dimensions of performance those performance measurement systems address.

METHODS

A literature review was primarily conduced about performance measures in healthcare organisations. A comparative study was secondly made to identify the different performance dimensions that are present in the literature during the last decade. Forty-nine studies were considered and sixteen proposal frameworks were used to make the comparative analyses.

RESULTS

We classified dimensions depending on the frequency of mobilisation of their components in four categories: the stars, the first runners-up, the opportunists and the forgotten ones. For each of the dimensions presented in this classification, the main types of KPIs proposed in the theoretical frameworks are presented. A discussion on relevance and possible blind spots is then conducted.

CONCLUSION

Although they were a lot of proposal frameworks of KPI proposed in the last decades to assess healthcare organisations, some dimensions remain underrepresented. There is still a need to develop structure KPI and describe their links. To go further, the development of dashboards asks the question of the definition of KPI, the description of their interconnections and their temporality of driving, because static performance reporting systems are not able to completely satisfy healthcare manager's decision support needs.

Quality improvement in pediatric nephrology-a practical guide

Improving quality of care delivery is an important focus for all practicing physicians. Frontline clinicians are in a great position to identify clinical problems and find innovative solutions. The current review describes the method used for quality improvement based on the Model for Improvement, a structural framework to guide improvement work. At its basis are three fundamental questions: What are we trying to accomplish? How will I know that a change will lead to improvement? And what changes could we make that will result in improvement? This preparation phase aims to identify and understand the problem, choose an intervention, and determine reliable measures to gauge improvement. The intervention is then tested using PLAN-DO-STUDY-ACT (PDSA) cycles, an iterative approach to systematically improve processes and outcomes. PLAN focuses on defining the goal of the cycle and describing in details what will be done. DO concentrates on the concrete application of the plan. STUDY focuses on data analyses as ACT identifies lessons learned from the cycle and orientate the goals of the following PDSA cycle. Learning from each cycle, developing an interdisciplinary team and repeated interventions are core principles involved in implementing a sustainable quality improvement program. The Model for Improvement will be illustrated by a common quality problem in pediatric nephrology.

Assessment of Quality of Care Using Information on Patient Satisfaction at Adult Oncology Center of Tikur Anbessa Specialized Hospital, Ethiopia: A Cross-Sectional Study

BACKGROUND

Cancer is one of the leading causes of morbidity and mortality in the world. It results in considerable mental, physical, and emotional stress for patients. Because of the nature and impact of the disease, and its treatment, measurements of patient satisfaction are important to bring to the attention of health-care providers in order to improve care.

OBJECTIVE

To assess patient satisfaction at the adult oncology center of Tikur Anbessa Specialized Hospital, Ethiopia using the EORTC PATSAT-C33 tool.

METHODS

A facility-based cross-sectional study was conducted from January 2019 to May 2019. A consecutive sampling technique was employed to recruit a total of 384 study participants. Informed consent was obtained for each participant and data were collected using an interviewer-administered questionnaire. Ethical clearance and approval of the study protocol were obtained from the institutional ethics review board of the school of pharmacy. Descriptive statistics was used to summarize the data, while multivariate linear regression analysis was employed to explore factors affecting patient satisfaction. P<0.05 was considered as statistically significant.

RESULTS

Among a total of 384 study participants, the majority were female (65.9%) and the median age was 49 years. In most (65.9%) participants, the health-care service cost was covered by patients themselves; the majority of them were treated for gynecological malignancy (37.2%) and most received chemotherapy + surgery (37.2%). The mean score for the EORTC-PATSAT33 scales for overall satisfaction was 44.8 out of 100. Place of residence, gender, type of cancer, duration since treatment started, age and source of health-care costs were factors associated with patient satisfaction and all together explained 83% (adjusted R square=0.830, P<0.0001) of variance. Of these, residence (where patients came from) accounted for most (78.7%) of the variance (adjusted R square=0.787, P<0.0001).

CONCLUSION

The mean overall satisfaction of patients with the services provided at the outpatient adult oncology center of TASH was significantly lower than previously reported in the world literature, which was >70. Hence, a concerted effort must be made to understand and improve patient satisfaction in oncology health-care services in Ethiopia.

Evaluating quality of care for patients with rotator cuff disorders

Background

Measuring quality in healthcare is vital in evaluating patient outcomes and system performance. The availability of reliable and valid information about the quality of care for patients presenting with rotator cuff disorders (RCD) in Alberta, Canada is scarce. The objective of this study is to measure quality of care for patients with RCD in order to identify areas of improvement.

Methods

This study employs descriptive survey research design. Between March 2015 and November 2016, a convenience sample of patients presenting with chronic, full-thickness rotator cuff tears to two sport medicine centres in Calgary and Edmonton, Alberta completed two questionnaires: the Healthcare Access and Patient Satisfaction Questionnaire (HAPSQ) and the Rotator Cuff Quality-of-Life Index (RC-QOL). Data collected using both questionnaires were used to make judgments about quality of care. Quality of care was evaluated using six dimensions of quality defined by the Alberta Quality Matrix for Health: accessibility, acceptability, efficiency, effectiveness, appropriateness, and safety. Data was also used to compare current patient clinical pathways to ideal clinical pathway algorithms and used to make judgments about the appropriateness and safety of healthcare practices.

Results

One hundred seventy-one patients participated in the study. The longest mean waiting times for medical services in Alberta were for magnetic resonance imaging (MRI) received in the public sector (103 days) and consultation by orthopaedic surgeon (172 days). Patient satisfaction with respect to quality of care was lowest for emergency room physician and highest for orthopaedic surgeon visits. Patients were treated by a mean of 2.5 physicians (SD: 0.77, range: 2–7). The total aggregate average cost per patient was $4541.19. The mean RC-QOL score for all patients was 42 (SD: 22). Only 54 patients (64%) requiring surgery were able to consult with a surgeon within benchmark timeframes. A comparison of current to ideal clinical pathway algorithms found that 38 patients (22%) experienced indirect clinical pathways, whereby care was fragmented and patients received care from multiple and often, redundant healthcare professionals.

Conclusion

There is a discrepancy between current and ideal clinical pathways whereby some patients are experiencing quality of care that is inefficient, disjointed, and less than ideal.

Quality management practices and their effects on the performance of public hospitals

Purpose

To face profound changes from decreasing funding, growing patient expectations and increasing competition in the health-care market, public hospitals began to implement effective quality management (QM) practices following manufacturing and other service industries. However, there was little knowledge relevant to the impact of QM practices on the performance of public hospitals. The study aims to shed some further light on this issue.

Design/methodology/approach

The paper extends the previous empirical research to the health-care sectors and suggests the research framework of QM practice-performance relationships in public hospitals. For validation purposes, a cross-sectional survey involving 204 quality managers and directors of large public hospitals was carried out between April and October 2013 in Zhejiang Province, China. Structural equation modeling was used to test the hypothesized relationship between QM practices and hospital performance.

Findings

Empirical results support that the implementation of QM practices can bring many benefits to sample hospitals. The dimensions of employee relations and process management are directly related to the health-care and non-health-care performance of public hospitals.

Originality/value

It explores the relationship between QM practices and hospital performance based on empirical results from Chinese public hospitals, whereas few studies have been conducted within the context of public health-care sectors in developing countries. The empirical results could enhance hospital managers’ understanding of the nature of QM practice-performance relationship and help mangers re-allocate more resources to those elements of the QM systems that have the most significant impact on hospital performance.