What are the most effective strategies for improving quality and safety of health care?

American Society for Microbiology evidence-based laboratory medicine practice guidelines to reduce blood culture contamination rates: a systematic review and meta-analysis

SUMMARYBlood cultures (BCs) are one of the critical tests used to detect bloodstream infections. BC results are not 100% specific. Interpretation of BC results is often complicated by detecting microbial contamination rather than true infection. False positives due to blood culture contamination (BCC) vary from 1% to as high as >10% of all BC results. False-positive BC results may result in patients undergoing unnecessary antimicrobial treatments, increased healthcare costs, and delay in detecting the true cause of infection or other non-infectious illness. Previous guidelines from the Clinical and Laboratory Standards Institute, College of American Pathologists, and others, based on expert opinion and surveys, promoted a limit of ≤3% as acceptable for BCC rates. However, the data supporting such recommendations are controversial. A previous systematic review of BCC examined three practices for reducing BCC rates (venipuncture, phlebotomy teams, and pre-packaged kits). Subsequently, numerous studies on different practices including using diversion devices, disinfectants, and education/training to lower BCC have been published. The goal of the current guideline is to identify beneficial intervention strategies to reduce BCC rates, including devices, practices, and education/training by providers in collaboration with the laboratory. We performed a systematic review of the literature between 2017 and 2022 using numerous databases. Of the 11,319 unique records identified, 311 articles were sought for full-text review, of which 177 were reviewed; 126 of the full-text articles were excluded based on pre-defined inclusion and exclusion criteria. Data were extracted from a total of 49 articles included in the final analysis. An evidenced-based committee's expert panel reviewed all the references as mentioned in Data Collection and determined if the articles met the inclusion criteria. Data from extractions were captured within an extraction template in the US Agency for Healthcare Research and Quality's Systematic Review Data Repository (https://srdr.ahrq.gov/). BCC rates were captured as the number of events (contaminated samples) per arm (standard practice versus improvement practice). Modified versions of the National Heart, Lung, and Blood Institute Study Quality Assessment Tools were used for risk of bias assessment (https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools). We used Grading of Recommendations, Assessment, Development and Evaluations to assess strength of evidence. There are several interventions that resulted in significant reduction in BCC rates: chlorhexidine as a disinfectant for skin preparation, using a diversion device prior to drawing BCs, using sterile technique practices, using a phlebotomy team to obtain BCs, and education/training programs. While there were no substantial differences between methods of decreasing BCC, our results indicate that the method of implementation can determine the success or failure of the intervention. Our evidence-based systematic review and meta-analysis support several interventions to effectively reduce BCC by approximately 40%-60%. However, devices alone without an education/training component and buy-in from key stakeholders to implement various interventions would not be as effective in reducing BCC rates.

Building capacity and capability for quality improvement: insights from a nascent regional health system

OBJECTIVES

Quality improvement (QI) is critical in facilitating advancements in patient outcomes, system efficiency and professional growth. This paper aimed to elucidate the underlying rationale and framework guiding JurongHealth Campus (JHC), a nascent Regional Health System, in developing its QI capacity and capability at all levels of the organisation.

METHODS

An exhaustive analysis of high-performance management systems and effective improvement frameworks was conducted, and the principles were customised to suit the local context.A three-phased approach was applied: (1) developing the JHC QI framework; (2) building capacity through a dosing approach and (3) building capability through QI projects and initiatives using the model for improvement (MFI). Three components of the RE-AIM implementation strategy were assessed: (1) Reach-overall percentage of staff trained; (2) Effectiveness-outcomes from organisation-wide improvement projects and (3) Adoption-number of QI projects collated and presented.

RESULTS

The percentage of staff trained in QI increased from 11.3% to 22.0% between January 2020 and March 2024, with over 350 projects documented in the central repository. The effectiveness of the MFI was demonstrated by improving inpatient discharges before 12pm performance from 21.52% to 25.84% and reducing the 30-day inpatient readmission rate from 13.92% to 12.96%.

CONCLUSION

Four critical factors for an effective QI framework were identified: (1) establishing a common language for improvement; (2) defining distinct roles and skills for improvement at different levels of the organisation; (3) adopting a dosing approach to QI training according to the defined roles and skills and (4) building a critical mass of committed staff trained in QI practice. The pragmatic approach to developing QI capability is both scalable and applicable to emerging healthcare institutions.

Impact of health system governance on healthcare quality in low-income and middle-income countries: a scoping review

INTRODUCTION

Improving healthcare quality in low-/middle-income countries (LMICs) is a critical step in the pathway to Universal Health Coverage and health-related sustainable development goals. This study aimed to map the available evidence on the impacts of health system governance interventions on the quality of healthcare services in LMICs.

METHODS

We conducted a scoping review of the literature. The search strategy used a combination of keywords and phrases relevant to health system governance, quality of healthcare and LMICs. Studies published in English until August 2023, with no start date limitation, were searched on PubMed, Cochrane Library, CINAHL, Web of Science, Scopus, Google Scholar and ProQuest. Additional publications were identified by snowballing. The effects reported by the studies on processes of care and quality impacts were reviewed.

RESULTS

The findings from 201 primary studies were grouped under (1) leadership, (2) system design, (3) accountability and transparency, (4) financing, (5) private sector partnerships, (6) information and monitoring; (7) participation and engagement and (8) regulation.

CONCLUSIONS

We identified a stronger evidence base linking improved quality of care with health financing, private sector partnerships and community participation and engagement strategies. The evidence related to leadership, system design, information and monitoring, and accountability and transparency is limited.

Unsafe care in residential settings for older adults: a content analysis of accreditation reports

Residents of aged care services can experience safety incidents resulting in preventable serious harm. Accreditation is a commonly used strategy to improve the quality of care; however, narrative information within accreditation reports is not generally analysed as a source of safety information to inform learning. In Australia, the Aged Care Quality and Safety Commission (ACQSC), the sector regulator, undertakes over 500 accreditation assessments of residential aged care services against eight national standards every year. From these assessments, the Aged Care Quality and Safety Commission generates detailed Site Audit Reports. In over one-third (37%) of Site Audit Reports, standards relating to Personal and Clinical Care (Standard 3) are not being met. The aim of this study was to identify the types of resident Safety Risks that relate to Personal and Clinical Care Standards not being met during accreditation or re-accreditation. These data could inform priority setting at policy, regulatory, and service levels. An analytical framework was developed based on the World Health Organization's International Classification for Patient Safety and other fields including Clinical Issue (the issue related to the incident impacting the resident, e.g. wound/skin or pain). Information relating to safety incidents in the Site Audit Reports was extracted, and a content analysis undertaken using the analytical framework. Clinical Issue and the International Classification for Patient Safety-based classification were combined to describe a clinically intuitive category ('Safety Risks') to describe ways in which residents could experience unsafe care, e.g. diagnosis/assessment of pain. The resulting data were descriptively analysed. The analysis included 65 Site Audit Reports that were undertaken between September 2020 and March 2021. There were 2267 incidents identified and classified into 274 types of resident Safety Risks. The 12 most frequently occurring Safety Risks account for only 32.3% of all incidents. Relatively frequently occurring Safety Risks were organisation management of infection control; diagnosis/assessment of pain, restraint, resident behaviours, and falls; and multiple stages of wounds/skin management, e.g. diagnosis/assessment, documentation, treatment, and deterioration. The analysis has shown that accreditation reports contain valuable data that may inform prioritization of resident Safety Risks in the Australian residential aged care sector. A large number of low-frequency resident Safety Risks were detected in the accreditation reports. To address these, organizations may use implementation science approaches to facilitate evidence-based strategies to improve the quality of care delivered to residents. Improving the aged care workforces' clinical skills base may address some of the Safety Risks associated with diagnosis/assessment and wound management.

The Cystic Fibrosis Learning Network: A mixed methods evaluation of program goals, attributes, and impact

Introduction

The Cystic Fibrosis (CF) Foundation sponsored the design, pilot testing, and implementation of the CF Learning Network (CFLN) to explore how the Foundation's Care Center Network (CCN) could become a learning health system. Six years after the design, the Foundation commissioned a formative mixed methods evaluation of the CFLN to assess: CFLN participants' understanding of program goals, attributes, and perceptions of current and future impact.

Methods

We performed semi-structured interviews with CFLN participants to identify perceived goals, attributes, and impact of the network. Following thematic analyses, we developed and distributed a survey to CFLN members and a matched sample of CCN programs to understand whether the themes were unique to the CFLN.

Results

Interviews with 24 CFLN participants were conducted. Interviewees identified the primary CFLN goal as improving outcomes for people living with CF, with secondary goals of providing training in quality improvement (QI), creating a learning community, engaging all stakeholders in improvement, and spreading best practices to the CCN. Project management, use of data, common QI methods, and the learning community were seen as critical to success. Survey responses were collected from 103 CFLN members and 25 CCN members. The data revealed that CFLN respondents were more likely than CCN respondents to connect with other CF programs, routinely use data for QI, and engage patient and family partners in QI.

Conclusions

Our study suggests that the CFLN provides value beyond that achieved by the CCN. Key questions remain about whether spread of the CFLN could improve outcomes for more people living with CF.

Use of an open-source electronic health record to establish a "virtual hospital": A tale of two curricula

BACKGROUND

The electronic health record (EHR) is central to medical informatics. Its use is also recognized as an important skill for future clinicians. Typically, medical students' first exposure to an EHR is when they start their clinical internships, and medical informatics students may or may not get experience with an EHR before graduation. We describe the process of implementing an open-source EHR in two curricula: Medicine and Medical informatics. For medical students, the primary goals were to allow students to practice analyzing information from the EHR, creating therapeutic plans, and communicating with their colleagues via the EHR before they start their first clinical rotations. For medical informatics students, the primary goal was to give students hands-on experience with creating decision support in an EHR.

APPROACH

We used the OpenMRS electronic health record with a custom decision support module based on Arden Syntax. Medical students needed a secure, stable environment to practice medical reasoning. Medical informatics students needed a more isolated system to experiment with the EHR's internal configuration. Both student groups needed synthetic patient cases that were realistic, but in different aspects. For medical students, it is essential that these cases are clinically consistent, and events unfold in a logical order. By contrast, synthetic data for medical informatics students should mimic the data quality problems found in real patient data.

OUTCOMES

Medical informatics students show more mature reasoning about data quality issues and workflow integration than prior to using the EHR. Comments on both course evaluations have been positive, including comments on how working with a real-world EHR provides a realistic experience.

CONCLUSION

The open-source EHR OpenMRS has proven to be a valuable addition to both the medicine and medical informatics curriculum. Both sets of students experience use of the EHR as giving them valuable, realistic learning experiences.

Does public health policy quality foster state innovation capacity? Evidence from a global panel data

The design and implementation of public health policy may shape state innovation capacity with governance effectiveness, political stability, and government integrity. Previous studies, however, failed to incorporate these relationships simultaneously. This study aims to combine two distinct scholarships to examine whether the quality of policies in the public health sector contributes to state innovation capacity. We extracted data from the WHO international health regulatory dataset covering the WHO Member States between 2010 and 2017 to investigate the relationship (N = 145). Our fixed-effects models and regression discontinuity design (RDD) suggest a positive impact of public health policy quality on state innovation capacity. There are several contributions to the study of the relationship between public health and innovation in this study. Firstly, it fills a theoretical void concerning the relationship between policy development and implementation in the public health sector and country-specific innovations. Second, it provides an empirical quantitative analysis of policy quality in the public health sector. Third, this study contributes evidence that public health plays an important role in fostering state innovation beyond urbanization, investment in science and technology, and foreign trade. Furthermore, our quasi-experimental evidence found that this mechanism may be significant only between the more politically stable countries and the most politically stable countries. These contributions have empirical implications for governments across the world that seek to balance public health and innovation capacity in the context of the post-pandemic era.

What Do We Know About Teamwork in Chinese Hospitals? A Systematic Review

Background and Objective: Improving quality of care is one of the primary goals in current Chinese hospital reforms. Teamwork can play an essential role. Characteristics of teamwork and interventions for improving teamwork in hospitals have been widely studied. However, most of these studies are from a Western context; evidence from China is scarce. Because of the contextual differences between China and Western countries, empirical evidence on teamwork from Western hospitals may have limited validity in China. This systematic review aims to advance the evidence base and understanding of teamwork in Chinese hospitals. Methods: Both English (i.e., Embase, Medline, and Web of Science) and Chinese databases (i.e., CNKI, CQVIP, and Wanfang) were searched for relevant articles until February 6, 2020. We included the studies that empirically researched teamwork in Chinese hospitals. Studies were excluded if they (1) were not conducted in hospitals in Mainland China, (2) did not research teamwork on team interventions, (3) were not empirical, (4) were not written in English or Chinese, (5) were not published in peer-reviewed journals, and (6) were not conducted in teams that provide direct patient care. Both deductive and inductive approaches were used to analyze data. The Mixed Methods Appraisal Tool (MMAT) was used to assess their methodological quality. Results: A total of 70 articles (i.e., 39 English articles and 31 Chinese articles) were included. The results are presented in two main categories: Teamwork components and Team interventions. The evidence regarding the relationships among inputs, processes, and outcomes is scarce and mostly inconclusive. The only conclusive evidence shows that females perceive better team processes than males. Similar types of training and tools were introduced as can be found in Western literature, all showing positive effects. In line with the Chinese health reforms, many of the intervention studies regard the introduction of multidisciplinary teams (MDTs). The evidence on the implementation of MDTs reveals that they have led to lower complication rates, shorter hospital stays, higher diagnosis accuracy, efficiency improvement, and a variety of better disease-specific clinical outcomes. Evidence on the effect on patient survival is inconclusive. Conclusion: The Chinese studies on teamwork components mainly focus on the input-process relationship. The evidence provided on this relationship is, however, mostly inconclusive. The intervention studies in Chinese hospitals predominantly focus on patient outcomes rather than organizational and employee outcomes. The introduction of training, tools, and MDTs generally shows promising results. The evidence from primary hospitals and rural areas, which are prioritized in the health reforms, is especially scarce. Advancing the evidence base on teamwork, especially in primary hospitals and rural areas, is needed and can inform policy and management to promote the health reform implementation. Systematic Review Registration: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020175069, identifier CRD42020175069.

Inter-rater agreement of scores to assess quality of care in public sector primary health care facilities - A pattern of performance

PURPOSE

To determine if the scores obtained from the Ideal Clinic Assessment Tool (ICAT) used to assess the quality of care in public Primary Health Care facilities in South Africa showed inter-rater agreement between self-assessments, district peer reviews and cross-district peer reviews. The ICAT scores obtained in the three types of reviews were paired as follows: self-assessments/district peer reviews, self-assessment/cross-district peer reviews and district/cross-district peer reviews. The global scores and averages of the Vital elements for the three paired reviews for 587 facilities across the country were compared using Bland-Altman plots.

RESULTS

The Bland-Altman plots showed no inter-rater agreement between the global scores and averages of the Vital elements for the facilities in any of the paired reviews (n = 1 761 reviews). Similarly, there was no inter-rater agreement between the global scores of the three paired reviews in any of the nine provinces in the country.

CONCLUSION

There is still a need to continue to conduct both district and cross-district reviews despite the substantial cost of doing so. Further studies are required to determine what factors contributed to the disagreement in scores between the different types of reviews despite the preparatory training of reviewers.

The Combined Effect of Safety Specific Transformational Leadership and Safety Consciousness on Psychological Well-Being of Healthcare Workers

Occupational health researchers have begun to realize that the psychological well-being of healthcare workers who are providing treatment against COVID-19 is deteriorating. However, there is minimal research conducted on it, particularly in the context of leadership. The current study aims to fill this important gap by identifying critical factors that can enhance the psychological well-being of healthcare workers. We proposed that safety specific transformational leadership enhances psychological well-being among healthcare workers, and COVID-19 perceived risk mediates this relationship. Furthermore, the safety conscientiousness of healthcare workers was proposed to be a boundary condition that enhances the negative relationship between safety-specific transformational leadership and COVID-19 perceived risk. Data were collected from healthcare workers (N = 232) treating COVID-19 patients in the hospitals of Pakistan through well-established adopted questionnaires. The discriminant and convergent validity of the data was tested through confirmatory factor analysis by using AMOS statistical package. The mediation and moderation hypotheses were tested by using PROCESS Macro by Hayes. The results showed that safety specific transformational leadership enhances psychological well-being among healthcare workers, and COVID-19 perceived risk mediates this relationship. Moderation results also confirmed that safety conscientiousness moderates the relationship between safety specific transformational leadership and COVID-19 perceived risk. This study offers implications for both researchers and practitioners.

The effectiveness of clinical pathway software in inpatient settings: A systematic review

BACKGROUND

Various studies have assessed the effectiveness of clinical pathways (CPs) in inpatient settings and provided systematic evidence that they positively affect patient outcomes and efficiency of care, thus lowering costs. In recent years, CP implementation is often combined or extended with clinical pathway software (CPS). Until now, no systematic literature review appears to exist which synthesizes the evidence on the effectiveness of CPS in inpatient settings, in relation to the CPs they support.

OBJECTIVES

The purpose of this study was to systematically review evidence on (perceived) effectiveness of clinical pathway software (CPS) and investigate mechanisms explaining the effects of CPS implementation on outcomes.

METHODS

We searched MEDLINE via PubMed and Scopus, for English-language original articles. Articles were included if they examined the effectiveness and/or the perceived effectiveness of CPS in the inpatient setting. They were analyzed for evidence on structure, process and outcome effects, as well as for mechanisms explaining such effects in relation to contextual factors.

RESULTS

From 2904 articles, 12 studies met our inclusion criteria. The seven studies reporting on adherence provide conclusive evidence that CPSs can improve adherence. We also found conclusive evidence of improvement of process related measures regarding appropriate diagnostics, timeliness of care, and length of stay (LOS). Evidence on costs and outcomes is weak and/or less conclusive. This holds true both for patient outcomes (e.g. mortality/patient satisfaction) and caregiver outcomes (e.g. user satisfaction). The studies presented no direct evidence on mechanisms explaining how CPS relate to process and outcome improvements.

CONCLUSIONS

The primary effects of CPS to increase adherence may in turn positively impact other process indicators such as LOS, timeliness of care, and diagnostic effectiveness. Subsequent effects on costs, outcomes for patients, physicians and nurses remain inconclusive and call for further research. Further research should explicitly take context into account. The scarce and weak evidence-base relating CPS implementation to process and outcome effects needs development along the same lines.

Quality Measure Public Reporting Is Associated with Improved Outcomes Following Hip and Knee Replacement

BACKGROUND

Given the inclusion of orthopaedic quality measures in the Centers for Medicare & Medicaid Services national hospital payment programs, the present study sought to assess whether the public reporting of total hip arthroplasty (THA) and total knee arthroplasty (TKA) risk-standardized readmission rates (RSRRs) and complication rates (RSCRs) was temporally associated with a decrease in the rates of these outcomes among Medicare beneficiaries.

METHODS

Annual trends in national observed and hospital-level RSRRs and RSCRs were evaluated for patients who underwent hospital-based inpatient hip and/or knee replacement procedures from fiscal year 2010 to fiscal year 2016. Hospital-level rates were calculated with use of the same measures and methodology that were utilized in public reporting. Annual trends in the distribution of hospital-level outcomes were then examined with use of density plots.

RESULTS

Complication and readmission rates and variation declined steadily from fiscal year 2010 to fiscal year 2016. Reductions of 33% and 25% were noted in hospital-level RSCRs and RSRRs, respectively. The interquartile range decreased by 18% (relative reduction) for RSCRs and by 34% (relative reduction) for RSRRs. The frequency of risk variables in the complication and readmission models did not systematically change over time, suggesting no evidence of widespread bias or up-coding.

CONCLUSIONS

This study showed that hospital-level complication and readmission rates following THA and TKA and the variation in hospital-level performance declined during a period coinciding with the start of public reporting and financial incentives associated with measurement. The consistently decreasing trend in rates of and variation in outcomes suggests steady improvements and greater consistency among hospitals in clinical outcomes for THA and TKA patients in the 2016 fiscal year compared with the 2010 fiscal year. The interactions between public reporting, payment, and hospital coding practices are complex and require further study.

LEVEL OF EVIDENCE

Prognostic Level III. See Instructions for Authors for a complete description of levels of evidence.

Mediators of change in healthcare organisations subject to external assessment: a systematic review with narrative synthesis

OBJECTIVES

External inspections are widely used to improve the quality of care. The effects of inspections remain unclear and little is known about how they may work. We conducted a narrative synthesis of research literature to identify mediators of change in healthcare organisations subject to external inspections.

METHODS

We performed a literature search (1980-January 2020) to identify empirical studies addressing change in healthcare organisations subject to external inspection. Guided by the Consolidated Framework for Implementation Research, we performed a narrative synthesis to identify mediators of change.

RESULTS

We included 95 studies. Accreditation was the most frequent type of inspection (n=68), followed by statutory inspections (n=19), and external peer review (n=9). Our findings suggest that the regulatory context in which the inspections take place affect how they are acted on by those being inspected. The way inspections are conducted seem to be critical for how the inspection findings are perceived and followed up. Inspections can engage and involve staff, facilitate leader engagement, improve communication and enable the creation of new networks for reflection on clinical practice. Inspections can contribute to creating an awareness of the inspected organisation's current practice and performance gaps, and a commitment to change. Moreover, they can contribute to facilitating the planning and implementation of change, as well as self-evaluation and the use of data to evaluate performance.

CONCLUSIONS

External inspections can affect different mediators of organisational change. The way and to what extent they do depend on a range of factors related to the outer setting, the way inspections are conducted and how they are perceived and acted on by the inspected organisation. To improve the quality of care, the organisational change processes need to involve and impact the way care is delivered to the patients.

Efficient Postoperative Disposition Selection in Pediatric Otolaryngology Patients: A Novel Approach

OBJECTIVE

Pediatric patients undergoing surgery on the aerodigestive tract require a wide range of postoperative airway support that may be difficult predict in the preoperative period. Inaccurate prediction of postoperative resource needs leads to care inefficiencies in the form of unanticipated intensive care unit (ICU) admissions, ICU bed request cancellations, and overutilization of ICU resources. At our hospital, inefficient utilization of pediatric intensive care unit (PICU) resources was negatively impacting safety, access, throughput, and finances. We hypothesized that actionable key drivers of inefficient ICU utilization at our hospital were operative scheduling errors and the lack of predictability of intermediate-risk patients and that improvement methodology could be used in iterative cycles to enhance efficiency of care. Through testing this hypothesis, we aimed to provide a framework for similar efforts at other hospitals.

STUDY DESIGN

Quality improvement initiative.

METHODS

Plan, Do, Study, Act methodology (PDSA) was utilized to implement two cycles of change aimed at improving level-of-care efficiency at an academic pediatric hospital. In PDSA cycle 1, we aimed to address scheduling errors with surgical order placement restriction, creation of a standardized list of surgeries requiring PICU admission, and implementation of a hard stop for postoperative location in the electronic medical record surgical order. In the PDSA cycle 2, a new model of care, called the Grey Zone model, was designed and implemented where patients at intermediate risk of airway compromise were observed for 2-5 hours in the post-anesthesia care unit. After this observation period, patients were then transferred to the level of care dictated by their current status. Measures assessed in PDSA cycle 1 were unanticipated ICU admissions and ICU bed request cancellations. In addition to continued analysis of these measures, PDSA cycle 2 measures were ICU beds avoided, safety events, and secondary transfers from extended observation to ICU.

RESULTS

In PDSA cycle 1, no significant decrease in unanticipated ICU admissions was observed; however, there was an increase in average monthly ICU bed cancellations from 36.1% to 45.6%. In PDSA cycle 2, average monthly unanticipated ICU admissions and cancelled ICU bed requests decreased from 1.3% to 0.42% and 45.6% to 33.8%, respectively. In patients observed in the Grey Zone, 229/245 (93.5%) were transferred to extended observation, avoiding admission to the ICU. Financial analysis demonstrated a charge differential to payers of $1.1 million over the study period with a charge differential opportunity to the hospital of $51,720 for each additional hospital transfer accepted due to increased PICU bed availability.

CONCLUSIONS

Implementation of the Grey Zone model of care improved efficiency of ICU resource utilization through reducing unanticipated ICU admissions and ICU bed cancellations while simultaneously avoiding overutilization of ICU resources for intermediate-risk patients. This was achieved without compromising safety of patient care, and was financially sound in both fee-for-service and value-based reimbursement models. While such a model may not be applicable in all healthcare settings, it may improve efficiency at other pediatric hospitals with high surgical volume and acuity.

LEVEL OF EVIDENCE

N/A Laryngoscope, 131:S1-S10, 2021.

Implementing high value back pain care in private physiotherapy in Australia: A qualitative evaluation of physiotherapists who participated in an "implementation to innovation" system

Objectives: Many barriers exist to delivering high-value care for people with low back pain (LBP). We have developed a multistrategy implementation system to overcome these barriers. Here we describe a qualitative evaluation of the experiences of private-sector physiotherapists implementing the system.

Design: PRISM (Practice-based innovation and implementation system) is an iterative clinician-as-scientist implementation program, tailored here for acute and subacute LBP. PRISM integrates strategies from behavioral change, implementation, and educational science fields. Semistructured interviews, group discussion forums, and electronic questionnaires were used to collect data at multiple time points that were then analyzed using an interpretative descriptive approach.

Participants: Six physiotherapists (purposive sample) practicing in private practice physiotherapy clinics in the Adelaide region, South Australia, were enrolled in the study.

Interventions: Interventions included an educational pain science and care workshop incorporating self-regulated learning principles, a co-planned clinical pathway, an electronic decision support tool, development and support of a community of practice, case study simulations, audit and feedback, and collaborative problem solving and innovation for physiotherapists.

Results: Participants’ experiences and perceptions centered around five themes: (1) knowledge and skills training; (2) networking and mentoring; (3) a clear clinical pathway; (4) practical tools; and (5) data feedback. Participants appraised the implementation process positively but identified patient receptiveness as a challenge at times. Suggestions for improvement included streamlining/automating data collection forms and processes and providing more simulation opportunities.

Conclusions: PRISM appears to be a promising approach to overcoming several barriers that prevent people with back pain from receiving high-value care. It consolidates and increases pain science knowledge and increases physiotherapist confidence in delivering high-value care. It appears to legitimize some current practices, enhance clinical reasoning and communication skills, extend knowledge in line with contemporary pain science, and facilitate the application of a biopsychosocial management approach. The high-level acceptance by participants provides a foundation for further research to test outcomes and delivery in different settings.

Contribution of the article

A quality improvement intervention designed to improve delivery of high-value care was well received by private practice physiotherapists.

Physiotherapists particularly valued using experiential learning to improve fluency in communicating with, and educating patients about, contemporary pain science.

A structured clinical pathway and tools guided physiotherapists on the basic elements of necessary care and allowed them to concentrate on higher levels of decision making and communication with patients.

Effects of social undermining in families on deviant workplace behaviours in Pakistani nurses

AIMS

To examine whether negative emotions could mediate the association linking social undermining in families (i.e. negative judgements that prevent the maintenance of positive familial ties) to nurses' deviant workplace behaviours (i.e. behaviours that disrupt the normal functioning of organisations), and whether neuroticism could moderate the association linking social undermining in families to negative emotions by adopting the spillover theory.

BACKGROUND

This study tested a moderated mediation model based on the hospital industry in Pakistan. Negative familial stressors can disrupt work-related behaviours, but it remains unknown as to how negative emotions and personality traits can affect this family-to-work relationship.

METHOD

Temporally segregated survey data were collected from nurses (n = 325 dyads) working in the hospitals of Pakistan.

RESULTS

Findings showed that social undermining in families triggered deviant workplace behaviours in Pakistani nurses through the mediating effect of negative emotions. High levels of neuroticism strengthened the association linking social undermining in families to negative emotions.

CONCLUSION

Our moderated mediated model showed that family-related stressors can "spill over" to the workplace and disrupt employee behaviours under the mediating effect of negative emotions. The perception of family-related negative emotions can also be increased among individuals with high levels of neuroticism.

IMPLICATIONS FOR NURSING MANAGEMENT

We recommend the establishment of social support networks and workshops for nurses to cope with the negative emotions they experienced from family and non-work domains.

Evaluating implementation and impact of a provincial quality improvement collaborative for the management of chronic diseases in primary care: the COMPAS+ study protocol

BACKGROUND

Chronic conditions such as diabetes and chronic obstructive pulmonary disease (COPD) are common and burdensome diseases primarily managed in primary care. Yet, evidence points to suboptimal quality of care for these conditions in primary care settings. Quality improvement collaboratives (QICs) are organized, multifaceted interventions that can be effective in improving chronic disease care processes and outcomes. In Quebec, Canada, the Institut national d'excellence en santé et en services sociaux (INESSS) has developed a large-scale QIC province-wide program called COMPAS+ that aims to improve the prevention and management of chronic diseases in primary care. This paper describes the protocol for our study, which aims to evaluate implementation and impact of COMPAS+ QICs on the prevention and management of targeted chronic diseases like diabetes and COPD.

METHODS

This is a mixed-methods, integrated knowledge translation study. The quantitative component involves a controlled interrupted time series involving nine large integrated health centres in the province. Study sites will receive one of two interventions: the multifaceted COMPAS+ intervention (experimental condition) or a feedback only intervention (control condition). For the qualitative component, a multiple case study approach will be used to achieve an in-depth understanding of individual, team, organizational and contextual factors influencing implementation and effectiveness of the COMPAS+ QICs.

DISCUSSION

COMPAS+ is a QI program that is unique in Canada due to its integration within the governance of the Quebec healthcare system and its capacity to reach many primary care providers and people living with chronic diseases across the province. We anticipate that this study will address several important gaps in knowledge related to large-scale QIC projects and generate strong and useful evidence (e.g., on leadership, organizational capacity, patient involvement, and implementation) having the potential to influence the design and optimisation of future QICs in Canada and internationally.

Does a Long-Term Quality and Safety Curriculum for Health Care Professionals Improve Clinical Practice? An Evaluation of Quality Improvement Projects

INTRODUCTION

Little is known about the effects on clinical practice of continuing education quality and safety curricula. The aim of this study is to gain insight into learning outcomes on the fourth level of the Kirkpatrick evaluation model for systematically deployed quality improvement projects performed by health care professionals during a Masters in Healthcare Quality and Safety in the Netherlands.

METHODS

The researchers reviewed 35 projects led by health care professionals in 16 different hospitals to determine their scopes and effects. Afterward, professionals took an online survey to determine the extent of their project's sustainability and spread.

RESULTS

Improving health care safety was the most prevalent quality dimension (n = 11, 31%). A positive change was measured by professionals for 64% (n = 35) of the primary outcomes. Statistical significance was measured in 19 (35%) of the outcomes, of which nine (47%) were found to have a statistically significant effect. A minority of professionals (17%) judged their project as sustained by the department, while some stated that the intervention (37%) or the results of the project (11%) had spread.

DISCUSSION

Although most projects indicated an improvement in their primary outcomes, only a few resulted in statistically significant changes. Teaching professionals in using evaluation methods that take into account the complex context where these projects are performed and teaching them leadership skills is needed to reduce the likelihood of unmeasured outcomes. Analyzing learning experiences of professionals in performing the project is important to see what they learned from performing quality improvement projects, providing experiences that may lead to sustainable effects in future projects.

Review of 128 quality of care mechanisms: A framework and mapping for health system stewards

Health system stewards have the critical task to identify quality of care deficiencies and resolve underlying system limitations. Despite a growing evidence-base on the effectiveness of certain mechanisms for improving quality of care, frameworks to facilitate the oversight function of stewards and the use of mechanisms to improve outcomes remain underdeveloped. This review set out to catalogue a wide range of quality of care mechanisms and evidence on their effectiveness, and to map these in a framework along two dimensions: (i) governance subfunctions; and (ii) targets of quality of care mechanisms. To identify quality of care mechanisms, a series of searches were run in Health Systems Evidence and PubMed. Additional grey literature was reviewed. A total of 128 quality of care mechanisms were identified. For each mechanism, searches were carried out for systematic reviews on their effectiveness. These findings were mapped in the framework defined. The mapping illustrates the range and evidence for mechanisms varies and is more developed for some target areas such as the health workforce. Across the governance sub-functions, more mechanisms and with evidence of effectiveness are found for setting priorities and standards and organizing and monitoring for action. This framework can support system stewards to map the quality of care mechanisms used in their systems and to uncover opportunities for optimization backed by systems thinking.

Perceived effectiveness of clinical pathway software: A before-after study in the Netherlands

BACKGROUND

Clinical pathways (CPs) increase in popularity and are known to lead to several benefits in the hospital environment. Clinical pathways can be either paper-based or software-based. It is known that paper-based CPs can result in more paperwork instead of simplifying daily routines of healthcare workers. Insufficient research has been done on the acceptance of software-based CPs by different user groups. Our aim in this study was to assess the effectiveness of the software-based CPs (CPS) from the perspective of healthcare professionals in the hospital environment as well as to investigate the differences in perceived effectiveness between user groups.

METHODS

Using surveys and interviews, data were collected in four departments of an academic medical center. A distinction was made between decision makers (DM) and executive staff (ES). The surveys contained questions based on the Technology Acceptance Model and four objectives of the software defined by the hospital. Statistical tests were used to investigate the effectiveness of CPS and study the differences between DM and ES. Interviews were recorded and transcribed based on grounded theory principals.

RESULTS

After implementation, monitoring protocol-based working was significantly improved (p = .026) and significantly higher efficiency on the work floor was reported (p = .046). ES perceived the software as less useful than expected (Md = 3.25 vs. Md = 2.75, p = .028) compared to DM and were less convinced of its ability to improve monitoring protocol-based working. The most important benefits of CPS as perceived by its users are the better overview of tasks it provides and facilitating documentation. Negative aspects mentioned were the lack of usability and the inflexibility of the software, and particularly ES claimed that the software did not increase their effectiveness.

CONCLUSION

Our study showed that CPS is effective from healthcare professionals' perspective due to its ability to increase monitoring of protocol-based working and by enhancing the efficiency on the work floor. However, the users also acknowledge that the software lacks usability and is not flexible enough, which results in an additional workload. Policy makers should be more focused on informing and training executive staff more thoroughly when implementing a CPS. Our results strongly suggest that executive staff members need to be convinced of its usefulness and the added value a CPS provides. Preferably, they should be involved in the design phase of the software.

Time Requirements of Paper-Based Clinical Workflows and After-Hours Documentation in a Multispecialty Academic Ophthalmology Practice

PURPOSE

To assess time requirements for patient encounters and estimate after-hours demands of paper-based clinical workflows in ophthalmology.

DESIGN

Time-and-motion study with a structured survey.

METHODS

This study was conducted in a single academic ophthalmology department. A convenience sample consisted of 7 attending ophthalmologists from 6 subspecialties observed during 414 patient encounters for the time-motion analysis and 12 attending ophthalmologists for the survey. Outcome measurements consisted of total time spent by attending ophthalmologists per patient and time spent on documentation, examination, and talking with patients. The survey assessed time requirements of documentation-related activities performed outside of scheduled clinic hours.

RESULTS

Among the 7 attending ophthalmologists observed (6 men and 1 woman), mean ± SD age 43.9 ± 7.1 years, during encounters with 414 patients (57.8 ± 24.6 years of age), total time spent per patient was 8.1 ± 4.8 minutes, with 2.8 ± 1.4 minutes (38%) for documentation, 1.2 ± 0.9 minutes (17%) for examination, and 3.3 ± 3.1 minutes (37%) for talking with patients. New patient evaluations required significantly more time than routine follow-up visits and postoperative visits. Higher clinical volumes were associated with less time per patient. Survey results indicated that paper-based documentation was associated with minimal after-hours work on weeknights and weekends.

CONCLUSIONS

Paper-based documentation takes up a substantial portion of the total time spent for patient care in outpatient ophthalmology clinics but is associated with minimal after-hours work. Understanding paper-based clinical workflows may help inform targeted strategies for improving electronic health record use in ophthalmology.

Bridging existing governance gaps: five evidence-based actions that boards can take to pursue high quality care

Objective To explore the impact of the organisational quality systems on quality of care in Victorian health services. Methods During 2015 a total of 55 focus groups were conducted with more than 350 managers, clinical staff and board members in eight Victorian health services to explore the effectiveness of health service quality systems. A review of the quality and safety goals and strategies outlined in the strategic and operating plans of the participating health services was also undertaken. Results This paper focuses on the data related to the leadership role of health service boards in ensuring safe, high-quality care. The findings suggest that health service boards are not fully meeting their governance accountability to ensure consistently high-quality care. The data uncovered major clinical governance gaps between stated board and executive aspirations for quality and safety and the implementation of these expectations at point of care. These gaps were further compounded by quality system confusion, over-reliance on compliance, and inadequate staff engagement. Conclusion Based on the existing evidence we propose five specific actions boards can take to close the gaps, thereby supporting improved care for all consumers. What is known about this topic? Effective governance is essential for high-quality healthcare delivery. Boards are required to play an active role in their organisation's pursuit of high quality care. What does this paper add? Recent government reports suggest that Australian health service boards are not fully meeting their governance requirements for high quality, safe care delivery, and our research pinpoints key governance gaps. What are the implications for practitioners? Based on our research findings we outline five evidence-based actions for boards to improve their governance of quality care delivery. These actions focus on an organisational strategy for high-quality care, with the chief executive officer held accountable for successful implementation, which is actively guided and monitored by the board.

Quality, safety and performance management in primary health care: from scoping review to research priority setting and implementation plan in the Eastern Mediterranean Region

INTRODUCTION

Strong primary health care (PHC) leads to better health outcomes, improves health equity and accelerates progress towards universal health coverage (UHC). The Astana Declaration on PHC emphasised the importance of quality care to achieve UHC. A comprehensive understanding of the quality paradigm of PHC is critical, yet it remains elusive in countries of the Eastern Mediterranean Region (EMR). This study used a multistep approach to generate a policy-relevant research agenda for strengthening quality, safety and performance management in PHC in the EMR.

METHODS

A multistep approach was adopted, encompassing the following steps: scoping review and generation of evidence and gap maps, validation and ranking exercises, and development of an approach for research implementation. We followed Joanna Briggs Institute guidelines for conducting scoping reviews and a method review of the literature to build the evidence and gap maps. For the validation and ranking exercises, we purposively sampled 55 high-level policy-makers and stakeholders from selected EMR countries. We used explicit multicriteria for ranking the research questions emerging from the gap maps. The approach for research implementation was adapted from the literature and subsequently tailored to address the top ranked research question.

RESULTS

The evidence and gap maps revealed limited production of research evidence in the area of quality, safety and performance management in PHC by country and by topic. The priority setting exercises generated a ranked list of 34 policy-relevant research questions addressing quality, safety and performance management in PHC in the EMR. The proposed research implementation plan involves collaborative knowledge generation with policy-makers along with knowledge translation and impact assessment.

CONCLUSION

Study findings can help inform and direct future plans to generate, disseminate and use research evidence to enhance quality, safety and performance management in PHC in EMR and beyond. Study methodology can help bridge the gap between research and policy-making.

Process evaluation of a behaviour change approach to improving clinical practice for detecting hereditary cancer

BACKGROUND

This retrospective process evaluation reports on the application of a 1-year implementation program to increase identification and management of patients at high risk of a hereditary cancer syndrome. The project used the Theoretical Domains Framework Implementation (TDFI) approach, a promising implementation methodology, used successfully in the United Kingdom to address patient safety issues. This Australian project run at two large public hospitals aimed to increase referrals of patients flagged as being at risk of Lynch syndrome on the basis of a screening test to genetic services. At the end of the project, the pathologists' processes had changed, but the referral rate remained inconsistent and low.

METHODS

Semi-structured interviews explored participants' perceptions of the TDFI approach and Health services researchers wrote structured reflections. Interview transcripts and reflections were coded initially against implementation outcomes for the various TDFI approach activities: acceptability, appropriateness, feasibility, value for time cost, and adoption. On a second pass, themes were coded around challenges to the approach.

RESULTS

Interviews were held with nine key project participants including pathologists, oncologists, surgeons, genetic counsellors and an administrative officer. Two health services researchers wrote structured reflections. The first of two major themes was 'Theory-related challenges', with subthemes of accessibility of theory underpinning the TDFI, commitment to that theory-based approach, and the problem of complexity. The second theme was 'Practical challenges' with subthemes of stakeholder management, navigating the system, and perceptions of the problem. Health services researchers reflected on the benefits of bridging professional divides and facilitating collective learning and problem solving, but noted frustrations around clinicians' time constraints that led to sparse interactions with the team, and lack of authority to effect change themselves.

CONCLUSIONS

Mixed success of adoption as an outcome was attributed to the complexity and highly nuanced nature of the setting. This made identifying the target behaviour, a key step in the TDFI approach, challenging. Introduced changes in the screening process led to new, unexpected issues yet to be addressed. Strategies to address challenges are presented, including using an internal facilitator with a focus on applying a theory-based implementation approach.

How the Smartphone Is Changing Allergy Diagnostics

PURPOSE OF REVIEW

Evidence-based clinical diagnosis of allergic disorders is increasingly challenging. Clinical decision support systems implemented in mobile applications (apps) are being developed to assist clinicians in diagnostic decisions at the point of care. We reviewed apps for allergic diseases general diagnosis, diagnostic refinement and diagnostic personalisation. Apps designed for specific medical devices are not addressed.

RECENT FINDINGS

Apps with potential usefulness in the initial diagnosis and diagnostic refinement of respiratory, food, skin and drug allergies are described. Apps to support diagnostic personalisation are not yet available. There is an urgent need to increase the scientific evidence on the real usefulness of these apps, as well as to develop new scientifically grounded apps designed and validated to support all allergic diseases and diagnostic levels. Apps have the potential to change the diagnosis of allergic diseases becoming part of the routine diagnostics toolset, but its usefulness needs to be established.

Electronic medical record-based tools aid in timely triage of disc-shaped foreign body ingestions

OBJECTIVES/HYPOTHESIS

Children presenting to the emergency department with coin-shaped foreign body (FB) ingestion must be evaluated urgently to rule out a button battery. As many of these ingestions are well-appearing on presentation, delays in triage put patients at risk for further injury.

STUDY DESIGN

Quality initiative.

METHODS

A quality initiative, utilizing electronic medical record (EMR)-based tools, was implemented at our academic children's hospital. A chief complaint pertaining to coin-shaped FB ingestion was created and was linked to a best practice advisory, instructing assignment of acuity level 2 and the order of a Stat x-ray. A link to the hospital's relevant algorithm was provided. A review was conducted comparing children who underwent FB removal preinitiative (January 1, 2016-January 28, 2017) and postinitiative (January 31, 2017-August 30, 2017). Primary outcomes were frequency of assignment of acuity level 2 and time from patient arrival to x-ray order placement and x-ray completion.

RESULTS

Thirty-six patients in the baseline group and 30 in the postintervention group underwent FB removal. The rate of appropriate acuity assignment increased from 63.8% (23/36) pre implementation to 100% (30/30) postimplementation (P = .0003). Median time from arrival to imaging ordered and completed decreased from 36.5 to 4 minutes (95% confidence interval [CI]: -44 to -17) and 59 to 41 minutes (95% CI: -39 to -1), respectively.

CONCLUSIONS

Utilization of EMR-based tools was associated with improved timeliness in initiation of care in metallic FB ingestion patients. Further initiatives will be aimed at downstream events in the diagnosis and treatment of these patients.

LEVEL OF EVIDENCE

NA Laryngoscope, 128:2697-2701, 2018.

The long way ahead to achieve an effective patient safety culture: challenges perceived by nurses

Background

The safety culture has recently attracted the attention of healthcare organizations. Considering the importance of the roles of nurses with regard to patient safety, their knowledge and experiences of the challenges that influence patient safety culture can facilitate the development and implementation of better strategies. The aim of this study was to explore the nurses’ experiences of the challenges influencing the implementation and integration of safety culture in healthcare.

Methods

A qualitative study with deep and semi-structured individual interviews was carried out using a purposive sampling method to select 23 nurses from four hospitals affiliated with a large medical university in Southeast Iran. Data were analysed using the conventional content analysis of Lundman and Graneheim.

Results

Data analysis reflected the main theme of the study, “A long way ahead of safety culture”. This theme includes four categories: 1) inadequate organizational infrastructure, 2) insufficient leadership effectiveness, 3) inadequate efforts to keep pace with national and international standards, and 4) overshadowed values of team participation.

Conclusion

While practical strategies for creating a safety culture may seem simple, their implementation is not necessarily easy. There are several challenges ahead for cultivating an effective and positive safety culture in healthcare organizations. To keep pace with international standards, healthcare managers must employ modern methods of management in order to overcome the challenges faced by the institutionalization of safety culture and to make a difference in the healthcare system.

Patient safety issues and concerns in Bhutan's healthcare system: a qualitative exploratory descriptive study

OBJECTIVES

To investigate what healthcare professionals perceived and experienced as key patient safety concerns in Bhutan's healthcare system.

DESIGN

Qualitative exploratory descriptive inquiry.

SETTINGS

Three different levels of hospitals, a training institute and the Ministry of Health, Bhutan.

PARTICIPANTS

In total, 140 healthcare professionals and managers.

METHODS

Narrative data were collected via conversational in-depth interviews and Nominal Group Meetings. All data were subsequently analysed using thematic analysis strategies.

RESULTS

The data revealed that medication errors, healthcare-associated infections, diagnostic errors, surgical errors and postoperative complications, laboratory/blood testing errors, falls, patient identification and communication errors were perceived as common patient safety concerns. Human and system factors were identified as contributing to these concerns. Instituting clinical governance, developing and improving the physical infrastructure of hospitals, providing necessary human resources, ensuring staff receive patient safety education and promoting 'good' communication and information systems were, in turn, all identified as processes and strategies critical to improving patient safety in the Bhutanese healthcare system.

CONCLUSION

Patient safety concerns described by participants in this study were commensurate with those identified in other low and middle-income countries. In order to redress these concerns, the findings of this study suggest that in the Bhutanese context patient safety needs to be conceptualised and prioritised.

A theory-informed systematic review of clinicians' genetic testing practices

This systematic literature review investigates factors impacting on clinicians' decisions to offer genetic tests in their practice, and maps them to a theoretical behaviour change framework. Better understanding of these factors will inform the design of effective interventions to integrate genomics tests into clinical care. We conducted a narrative synthesis of empirical research of medical specialists' perspectives on and experiences of offering genetic tests to their patients. This review was based upon the PRISMA statement and guidelines for reviewing qualitative research. Four electronic data sources were searched-MEDLINE, EMBASE, CINAHL, PubMed. Studies were independently assessed by two authors. Content analysis was applied to map the findings of included studies to a framework validated for behaviour and implementation research, the Theoretical Domains Framework (TDF). The TDF describes 14 factors known to influence behaviour and has been applied in diverse clinical settings to understand and/or modify health professional behaviour. Thirty-four studies published in 39 articles met inclusion and quality criteria. Most studies were published after 2011 (54%), Northern American (82%), quantitative in design (68%) and addressed familial cancer genetic tests (53%). Of the 14 TDF factors, 13 were identified. The three most common factors were: Environmental Context and Resources (n = 33), Beliefs about Consequences (n = 26), and Knowledge (n = 23). To support the adoption of genomic tests beyond specialist services, nuanced interventions targeting considerations beyond clinician education are needed. For instance, interventions addressing organisational constraints which may restrict clinicians' ability to offer genomic tests are required alongside those targeting factors intrinsic to the clinician.

Centralisation of acute stroke services in London: Impact evaluation using two treatment groups

The bundling of clinical expertise in centralised treatment centres is considered an effective intervention to improve quality and efficiency of acute stroke care. In 2010, 8 London Trusts were converted into Hyper Acute Stroke Units. The intention was to discontinue acute stroke services in 22 London hospitals. However, in reality, provision of services declined only gradually, and 2 years later, 15% of all patients were still treated in Trusts without a Hyper Acute Stroke Unit. This study evaluates the impact of centralising London's stroke care on 7 process and outcome indicators using a difference-in-difference analysis with two treatment groups, Hyper Acute and discontinued London Trusts, and data on all stroke patients recorded in the hospital episode statistics database from April 2006 to April 2014. The policy resulted in improved thrombolysis treatment and lower rates of pneumonia in acute units. However, 6 indicators worsened in the Trusts that were meant to discontinue services, including deaths within 7 and 30 days, readmissions, brain scan rates, and thrombolysis treatment. The reasons for these results are difficult to uncover and could be related to differences in patient complexity, data recording, or quality of care. The findings highlight that actual implementation of centralisation policies needs careful monitoring and evaluation.

A Critical Analysis of Purchasing Arrangements in Kenya: The Case of the National Hospital Insurance Fund

BACKGROUND

Purchasing refers to the process by which pooled funds are paid to providers in order to deliver a set of health care interventions. Very little is known about purchasing arrangements in low- and middle-income countries (LMICs), and certainly not in Kenya. This study aimed to critically analyse purchasing arrangements in Kenya, using the National Hospital Insurance Fund (NHIF) as a case study.

METHODS

We applied a principal-agent relationship framework, which identifies three pairs of principal-agent relationships (government-purchaser, purchaser-provider, and citizen-purchaser) and specific actions required within them to achieve strategic purchasing. A qualitative case study approach was applied. Data were collected through document reviews (statutes, policy and regulatory documents) and in-depth interviews (n=62) with key informants including NHIF officials, Ministry of Health (MoH) officials, insurance industry actors, and health service providers. Documents were summarised using standardised forms. Interviews were recorded, transcribed verbatim, and analysed using a thematic framework approach.

RESULTS

The regulatory and policy framework for strategic purchasing in Kenya was weak and there was no clear accountability mechanism between the NHIF and the MoH. Accountability mechanisms within the NHIF have developed over time, but these emphasized financial performance over other aspects of purchasing. The processes for contracting, monitoring, and paying providers do not promote equity, quality, and efficiency. This was partly due to geographical distribution of providers, but also due to limited capacity within the NHIF. There are some mechanisms for assessing needs, preferences, and values to inform design of the benefit package, and while channels to engage beneficiaries exist, they do not always function appropriately and awareness of these channels to the beneficiaries is limited.

CONCLUSION

Addressing the gaps in the NHIF's purchasing performance requires a number of approaches. Critically, there is a need for the government through the MoH to embrace its stewardship role in health, while recognizing the multiplicity of actors given Kenya's devolved context. Relatively recent decentralisation reforms present an opportunity that should be grasped to rewrite the contract between the government, the NHIF and Kenyans in the pursuit of universal health coverage (UHC).

For which clinical rules do doctors want decision support, and why? A survey of Dutch general practitioners

Despite the promise of decision support for improving care, alerts are often overridden or ignored. We evaluated Dutch general practitioners’ intention to accept decision support in a proposed implementation based on clinical rules regarding care for elderly patients, and their reasons for wanting or not wanting support. We developed a survey based on literature and structured interviews and distributed it to all doctors who would receive support in the proposed implementation (n = 43), of which 65 percent responded. The survey consisted of six questions for each of 20 clinical rules. Despite concerns about interruption, doctors tended to choose more interruptive forms of support. Doctors wanted support when they felt the rule represented minimal care, perceived a need to improve care, and felt responsible for the action and that they might forget to perform the action; doctors declined support due to feeling that it was unnecessary and due to concerns about interruption.

Governance arrangements for health systems in low-income countries: an overview of systematic reviews

BACKGROUND

Governance arrangements include changes in rules or processes that determine authority and accountability for health policies, organisations, commercial products and health professionals, as well as the involvement of stakeholders in decision-making. Changes in governance arrangements can affect health and related goals in numerous ways, generally through changes in authority, accountability, openness, participation and coherence. A broad overview of the findings of systematic reviews can help policymakers, their technical support staff and other stakeholders to identify strategies for addressing problems and improving the governance of their health systems.

OBJECTIVES

To provide an overview of the available evidence from up-to-date systematic reviews about the effects of governance arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on governance arrangements and informing refinements of the framework for governance arrangements outlined in the overview.

METHODS

We searched Health Systems Evidence in November 2010 and PDQ Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of governance arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use (health expenditures, healthcare provider costs, out-of-pocket payments, cost-effectiveness), healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty, employment) and that were published after April 2005. We excluded reviews with limitations that were important enough to compromise the reliability of the findings of the review. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.

MAIN RESULTS

We identified 7272 systematic reviews and included 21 of them in this overview (19 primary reviews and 2 supplementary reviews). We focus here on the results of the 19 primary reviews, one of which had important methodological limitations. The other 18 were reliable (with only minor limitations).We grouped the governance arrangements addressed in the reviews into five categories: authority and accountability for health policies (three reviews); authority and accountability for organisations (two reviews); authority and accountability for commercial products (three reviews); authority and accountability for health professionals (seven reviews); and stakeholder involvement (four reviews).Overall, we found desirable effects for the following interventions on at least one outcome, with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects. Decision-making about what is covered by health insurance- Placing restrictions on the medicines reimbursed by health insurance systems probably decreases the use of and spending on these medicines (moderate-certainty evidence). Stakeholder participation in policy and organisational decisions- Participatory learning and action groups for women probably improve newborn survival (moderate-certainty evidence).- Consumer involvement in preparing patient information probably improves the quality of the information and patient knowledge (moderate-certainty evidence). Disclosing performance information to patients and the public- Disclosing performance data on hospital quality to the public probably encourages hospitals to implement quality improvement activities (moderate-certainty evidence).- Disclosing performance data on individual healthcare providers to the public probably leads people to select providers that have better quality ratings (moderate-certainty evidence).

AUTHORS' CONCLUSIONS

Investigators have evaluated a wide range of governance arrangements that are relevant for low-income countries using sound systematic review methods. These strategies have been targeted at different levels in health systems, and studies have assessed a range of outcomes. Moderate-certainty evidence shows desirable effects (with no undesirable effects) for some interventions. However, there are important gaps in the availability of systematic reviews and primary studies for the all of the main categories of governance arrangements.

A review of national policies and strategies to improve quality of health care and patient safety: a case study from Lebanon and Jordan

Background

Improving quality of care and patient safety practices can strengthen health care delivery systems, improve health sector performance, and accelerate attainment of health-related Sustainability Development Goals. Although quality improvement is now prominent on the health policy agendas of governments in low- and middle-income countries (LMICs), including countries of the Eastern Mediterranean Region (EMR), progress to date has not been optimal. The objective of this study is to comprehensively review existing quality improvement and patient safety policies and strategies in two selected countries of the EMR (Lebanon and Jordan) to determine the extent to which these have been institutionalized within existing health systems.

Methods

We used a mixed methods approach that combined documentation review, stakeholder surveys and key informant interviews. Existing quality improvement and patient safety initiatives were assessed across five components of an analytical framework for assessing health care quality and patient safety: health systems context; national policies and legislation; organizations and institutions; methods, techniques and tools; and health care infrastructure and resources.

Results

Both Lebanon and Jordan have made important progress in terms of increased attention to quality and accreditation in national health plans and strategies, licensing requirements for health care professionals and organizations (albeit to varying extents), and investments in health information systems. A key deficiency in both countries is the absence of an explicit national policy for quality improvement and patient safety across the health system. Instead, there is a spread of several (disjointed) pieces of legal measures and national plans leading to fragmentation and lack of clear articulation of responsibilities across the entire continuum of care. Moreover, both countries lack national sets of standardized and applicable quality indicators for performance measurement and benchmarking. Importantly, incentive systems that link contractual agreement, regulations, accreditation, and performance indicators are underutilized in Lebanon and absent in Jordan. At the healthcare organizational level, there is a need to instill a culture of continuous quality improvement and promote professional training in quality improvement and patient safety.

Conclusion

Study findings highlight the importance of aligning policies, organizations, methods, capacities and resources in order to institutionalize quality improvement and patient safety practices in health systems. Gaps and dysfunctions identified can help inform national deliberations and dialogues among key stakeholders in each study country. Findings can also inform future quality improvement efforts in the EMR and beyond, with a particular emphasis on LMICs.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2528-1) contains supplementary material, which is available to authorized users.

Is medical perspective on clinical governance practices associated with clinical units' performance and mortality? A cross-sectional study through a record-linkage procedure

Objective:

Assessment of the knowledge and application as well as perceived utility by doctors of clinical governance tools in order to explore their impact on clinical units’ performance measured through mortality rates and efficiency indicators.

Methods:

This research is a cross-sectional study with a deterministic record-linkage procedure. The sample includes n = 1250 doctors (n = 249 chiefs of clinical units; n = 1001 physicians) working in six public hospitals located in the Emilia-Romagna Region in Italy. Survey instruments include a checklist and a research-made questionnaire which were used for data collection about doctors’ knowledge and application as well as perceived utility of clinical governance tools. The analysis was based on clinical units’ performance indicators which include patients’ mortality, extra-region active mobility rate, average hospital stay, bed occupancy, rotation and turnover rates, and the comparative performance index as efficiency indicators.

Results:

The clinical governance tools are known and applied differently in all the considered clinical units. Significant differences emerged between roles and organizational levels at which the medical leadership is carried out. The levels of knowledge and application of clinical governance practices are correlated with the clinical units’ efficiency indicators (bed occupancy rate, bed turnover interval, and extra-region mobility). These multiple linear regression analyses highlighted that the clinical governance knowledge and application is correlated with clinical units’ mortality rates (odds ratio, −8.677; 95% confidence interval, −16.654, −0.700).

Conclusion:

The knowledge and application, as well as perceived utility by medical professionals of clinical governance tools, are associated with the mortality rates of their units and with some efficiency indicators. However, the medical frontline staff seems to not consider homogeneously useful the clinical governance tools application on its own clinical practice.

What is a clinical pathway? Refinement of an operational definition to identify clinical pathway studies for a Cochrane systematic review

Clinical pathways (CPWs) are a common component in the quest to improve the quality of health. CPWs are used to reduce variation, improve quality of care, and maximize the outcomes for specific groups of patients. An ongoing challenge is the operationalization of a definition of CPW in healthcare. This may be attributable to both the differences in definition and a lack of conceptualization in the field of clinical pathways. This correspondence article describes a process of refinement of an operational definition for CPW research and proposes an operational definition for the future syntheses of CPWs literature. Following the approach proposed by Kinsman et al. (BMC Medicine 8(1):31, 2010) and Wieland et al. (Alternative Therapies in Health and Medicine 17(2):50, 2011), we used a four-stage process to generate a five criteria checklist for the definition of CPWs. We refined the operational definition, through consensus, merging two of the checklist's criteria, leading to a more inclusive criterion for accommodating CPW studies conducted in various healthcare settings. The following four criteria for CPW operational definition, derived from the refinement process described above, are (1) the intervention was a structured multidisciplinary plan of care; (2) the intervention was used to translate guidelines or evidence into local structures; (3) the intervention detailed the steps in a course of treatment or care in a plan, pathway, algorithm, guideline, protocol or other 'inventory of actions' (i.e. the intervention had time-frames or criteria-based progression); and (4) the intervention aimed to standardize care for a specific population. An intervention meeting all four criteria was considered to be a CPW. The development of operational definitions for complex interventions is a useful approach to appraise and synthesize evidence for policy development and quality improvement.

Enhancing the Effectiveness of Significant Event Analysis: Exploring Personal Impact and Applying Systems Thinking in Primary Care

INTRODUCTION

Significant event analysis (SEA) is well established in many primary care settings but can be poorly implemented. Reasons include the emotional impact on clinicians and limited knowledge of systems thinking in establishing why events happen and formulating improvements. To enhance SEA effectiveness, we developed and tested "guiding tools" based on human factors principles.

METHODS

Mixed-methods development of guiding tools (Personal Booklet-to help with emotional demands and apply a human factors analysis at the individual level; Desk Pad-to guide a team-based systems analysis; and a written Report Format) by a multiprofessional "expert" group and testing with Scottish primary care practitioners who submitted completed enhanced SEA reports. Evaluation data were collected through questionnaire, telephone interviews, and thematic analysis of SEA reports.

RESULTS

Overall, 149/240 care practitioners tested the guiding tools and submitted completed SEA reports (62.1%). Reported understanding of how to undertake SEA improved postintervention (P < .001), while most agreed that the Personal Booklet was practical (88/123, 71.5%) and relevant to dealing with related emotions (93/123, 75.6%). The Desk Pad tool helped focus the SEA on systems issues (85/123, 69.1%), while most found the Report Format clear (94/123, 76.4%) and would recommend it (88/123, 71.5%). Most SEA reports adopted a systems approach to analyses (125/149, 83.9%), care improvement (74/149, 49.7), or planned actions (42/149, 28.2%).

DISCUSSION

Applying human factors principles to SEA potentially enables care teams to gain a systems-based understanding of why things go wrong, which may help with related emotional demands and with more effective learning and improvement.

Evaluation of the physician quality improvement initiative: the expected and unexpected opportunities

BACKGROUND

The Physician Quality Improvement Initiative (PQII) uses a well-established multi-source feedback program, and incorporates an additional facilitated feedback review with their department chief. The purpose of this mixed methods study was to examine the value of the PQII by eliciting feedback from various stakeholders.

METHODS

All participants and department chiefs (n = 45) were invited to provide feedback on the project implementation and outcomes via survey and/or an interview. The survey consisted of 12 questions focused on the value of the PQII, it's influence on practice and the promotion of quality improvement and accountability.

RESULTS

A total of 5 chiefs and 12 physician participants completed semi structured interviews. Participants found the PQII process, report and review session helpful, self-affirming or an opportunity for self-reflection, and an opportunity to engage their leaders about their practice. Chiefs indicated the sessions strengthened their understanding, ability to communicate and engage physicians about their practice, best practices, quality improvement and accountability. Thirty participants (66.7 %) completed the survey; of the responders 75.9, 89.7, 86.7 % found patient, co-worker, and physician colleague feedback valuable, respectively. A total of 67.9 % valued their facilitated review with their chief and 55.2 % indicated they were contemplating change due to their feedback. Participants believed the PQII promoted quality improvement (27/30, 90.0 %), and accountability (28/30, 93.3 %).

CONCLUSIONS

The PQII provides an opportunity for physician development, affirmation and reflection, but also a structure to further departmental quality improvement, best practices, and finally, an opportunity to enhance communication, accountability and relationships between the organization, department chiefs and their staff.

The influence of context on the effectiveness of hospital quality improvement strategies: a review of systematic reviews

Background

It is now widely accepted that the mixed effect and success rates of strategies to improve quality and safety in health care are in part due to the different contexts in which the interventions are planned and implemented. The objectives of this study were to (i) describe the reporting of contextual factors in the literature on the effectiveness of quality improvement strategies, (ii) assess the relationship between effectiveness and contextual factors, and (iii) analyse the importance of contextual factors.

Methods

We conducted an umbrella review of systematic reviews searching the following databases: PubMed, Cochrane Database of Systematic Reviews, Embase and CINAHL. The search focused on quality improvement strategies included in the Cochrane Effective Practice and Organisation of Care Group taxonomy. We extracted data on quality improvement effectiveness and context factors. The latter were categorized according to the Model for Understanding Success in Quality tool.

Results

We included 56 systematic reviews in this study of which only 35 described contextual factors related with the effectiveness of quality improvement interventions. The most frequently reported contextual factors were: quality improvement team (n = 12), quality improvement support and capacity (n = 11), organization (n = 9), micro-system (n = 8), and external environment (n = 4). Overall, context factors were poorly reported. Where they were reported, they seem to explain differences in quality improvement effectiveness; however, publication bias may contribute to the observed differences.

Conclusions

Contextual factors may influence the effectiveness of quality improvement interventions, in particular at the level of the clinical micro-system. Future research on the implementation and effectiveness of quality improvement interventions should emphasize formative evaluation to elicit information on context factors and report on them in a more systematic way in order to better appreciate their relative importance.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-015-0906-0) contains supplementary material, which is available to authorized users.

Do quality improvement collaboratives' educational components match the dominant learning style preferences of the participants?

Background

Quality improvement collaboratives are used to improve healthcare by various organizations. Despite their popularity literature shows mixed results on their effectiveness. A quality improvement collaborative can be seen as a temporary learning organization in which knowledge about improvement themes and methods is exchanged. In this research we studied: Does the learning approach of a quality improvement collaborative match the learning styles preferences of the individual participants and how does that affect the learning process of participants?

Methods

This research used a mixed methods design combining a validated learning style questionnaire with data collected in the tradition of action research methodology to study two Dutch quality improvement collaboratives. The questionnaire is based on the learning style model of Ruijters and Simons, distinguishing five learning style preferences: Acquisition of knowledge, Apperception from others, Discovery of new insights, Exercising in fictitious situations and Participation with others.

Results

The most preferred learning styles of the participants were Discovery and Participation. The learning style Acquisition was moderately preferred and Apperception and Exercising were least preferred. The educational components of the quality improvement collaboratives studied (national conferences, half-day learning sessions, faculty site visits and use of an online tool) were predominantly associated with the learning styles Acquisition and Apperception. We observed a decrease in attendance to the learning activities and non-conformance with the standardized set goals and approaches.

Conclusions

We conclude that the participants’ satisfaction with the offered learning approach changed over time. The lacking match between these learning style preferences and the learning approach in the educational components of the quality improvement collaboratives studied might be the reason why the participants felt they did not gain new insights and therefore ceased their participation in the collaborative. This study provides guidance for future organisers and participants of quality improvement collaboratives about which learning approaches will best suit the participants and enhance improvement work.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-015-0915-z) contains supplementary material, which is available to authorized users.

Performance-related-pay in the UK public sector

Purpose

– The purpose of this paper is to provide an up-to-date, comprehensive, independent and credible assessment of relevant academic and other literature since 2007, on the effectiveness and value for money of performance-related-pay (PRP) in the public sector.

Design/methodology/approach

– PRP was studied using both economics-based literature and literature from the organisational and management field (including human resources, management sociology and psychology). An initial search of databases identified 7,401 documents regarding PRP in the public sector, which was reduced to 57 final papers included in the study (27 in the health sector, 16 in the education sector and 16 in the civil service) after abstract and full paper screening.

Findings

– The review found some evidence that PRP schemes can be effective across the three domains of the public sector for which there was evidence available (health, education and the civil service), but findings within and between the sectors are mixed, with scheme effectiveness often dependent on scheme design and organisational context.

Research limitations/implications

– The research highlights the importance of considering both economics-based and organisational literature when discussing PRP in the public sector, and the implications for motivation and PRP design.

Practical implications

– The results indicated that the design of PRP schemes could influence their effectiveness and outcomes, and the research suggests how the challenges of designing and implementing PRP schemes can be overcome in the public sector.

Social implications

– The review highlights that when implementing PRP schemes there may be gender differences in their overall effectiveness (especially in education) and there must be consideration for how fairly the PRP scheme is perceived.

Originality/value

– The paper uses literature from economics and behavioural sciences when looking at the motivational implications for PRP in the public sector.