Effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour or patient outcomes

Influence of external assessment on quality and safety in surgery: a qualitative study of surgeons' perspectives

INTRODUCTION

Transparency about the occurrence of adverse events has been a decades-long governmental priority, defining external feedback to healthcare providers as a key measure to improve the services and reduce the number of adverse events. This study aimed to explore surgeons' experiences of assessment by external bodies, with a focus on its impact on transparency, reporting and learning from serious adverse events. External bodies were defined as external inspection, police internal investigation, systems of patient injury compensation and media.

METHODS

Based on a qualitative study design, 15 surgeons were recruited from four Norwegian university hospitals and examined with individual semi-structured interviews. Data were analysed by deductive content analysis.

RESULTS

Four overarching themes were identified, related to influence of external inspection, police investigation, patient injury compensation and media publicity, (re)presented by three categories: (1) sense of criminalisation and reinforcement of guilt, being treated as suspects, (2) lack of knowledge and competence among external bodies causing and reinforcing a sense of clashing cultures between the 'medical and the outside world' with minor influence on quality improvement and (3) involving external bodies could stimulate awareness about internal issues of quality and safety, depending on relevant competence, knowledge and communication skills.

CONCLUSIONS AND IMPLICATIONS

This study found that external assessment might generate criminalisation and scapegoating, reinforcing the sense of having medical perspectives on one hand and external regulatory perspectives on the other, which might hinder efforts to improve quality and safety. External bodies could, however, inspire useful adjustment of internal routines and procedures. The study implies that the variety and interconnections between external bodies may expose the surgeons to challenging pressure. Further studies are required to investigate these challenges to quality and safety in surgery.

External inspection approaches and involvement of stakeholders' views in inspection following serious incidents - a qualitative mixed methods study from the perspectives of regulatory inspectors

OBJECTIVE

The objective was to gain knowledge about how external inspections following serious incidents are played out in a Norwegian hospital context from the perspective of the inspectors, and whether stakeholders' views are involved in the inspection.

METHODS

Based on a qualitative mixed methods design, 10 government bureaucrats and inspectors situated at the National Board of Health Supervision and three County Governors in Norway, were strategically recruited, and individual semi-structured interviews were conducted. Key official government documents were selected, collected, and thematically analyzed along with the interview data.

RESULTS

Our findings overall demonstrate two overarching themes: Theme (1) Perspectives on different external inspection approaches of responding and involving stakeholders in external inspection following serious incidents, Theme (2) Inspectors' internal work practices versus external expectations. Documents and all participants reported a development towards new approaches in external inspection, with more policies and regulatory attention to sensible involvement of stakeholders. Involvement and interaction with patients and informal caregivers could potentially inform the case complexity and the inspector's decision-making process. However, stakeholder involvement was sometimes complex and challenging due to e.g., difficult communication and interaction with patients and/or informal caregivers, due to resource demands and/or the inspector's lack of experience and/or relevant competence, different perceptions of the principle of sound professional practice, quality, and safety. The inspectors considered balancing the formal objectives and expectations, with the expectations of the public and different stakeholders (i.e. hospitals, patients and/or informal caregivers) a challenging part of their job. This balance was seen as an important part of the continuous development of ensuring public trust and legitimacy in external inspection processes.

CONCLUSIONS AND IMPLICATIONS

Our study suggests that the regulatory system of external inspection and its available approaches of responding to a serious incident in the Norwegian setting is currently not designed to accommodate the complexity of needs from stakeholders at the levels of hospital organizations, patients, and informal caregivers altogether. Further studies should direct attention to how the wider system of accountability structures may support the internal work practices in the regulatory system, to better algin its formal objectives with expectations of the public.

An Innovative Framework for Sustainable Development in Healthcare: The Human Rights Assessment

Healthcare providers are investing considerable resources for the development of quality management systems in hospitals. Contrary to these efforts, the number of tools that allow the evaluation of implementation efforts and the results of quality, security and sustainable development is quite limited. The purpose of the study is to develop a reference framework for quality and sustainable development in healthcare, Sanitary-Quality (San-Q) at the micro system level, which is compatible with applicable national and international standards in the field. The research method consisted of the study of literature, identification and analysis of good sustainability practices in healthcare, which allowed identification of the areas of the new San-Q framework: quality, economic, environmental, social, institutional and healthcare. These areas are incorporated into the core topics of social responsibility mentioned by ISO26000. A total of 57 indicators have been defined that make up the new reference framework. The evaluation format of the indicators is innovative through a couple of values: completion degree–significance. In the experimental part of the research, a pilot implementation of the San-Q framework at an emergency hospital was performed, the results recorded in terms of responsibility for human rights being presented. The conclusions of the study reveal the innovative aspects of the framework that facilitate the development of a sustainability strategy promoted through performance indicators, the results obtained after evaluation being useful in establishing a reference level of sustainability but also in developing sustainability policies.

The impact of hospital accreditation on the quality of healthcare: a systematic literature review

BACKGROUND

Accreditation is viewed as a reputable tool to evaluate and enhance the quality of health care. However, its effect on performance and outcomes remains unclear. This review aimed to identify and analyze the evidence on the impact of hospital accreditation.

METHODS

We systematically searched electronic databases (PubMed, CINAHL, PsycINFO, EMBASE, MEDLINE (OvidSP), CDSR, CENTRAL, ScienceDirect, SSCI, RSCI, SciELO, and KCI) and other sources using relevant subject headings. We included peer-reviewed quantitative studies published over the last two decades, irrespective of its design or language. Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, two reviewers independently screened initially identified articles, reviewed the full-text of potentially relevant studies, extracted necessary data, and assessed the methodological quality of the included studies using a validated tool. The accreditation effects were synthesized and categorized thematically into six impact themes.

RESULTS

We screened a total of 17,830 studies, of which 76 empirical studies that examined the impact of accreditation met our inclusion criteria. These studies were methodologically heterogeneous. Apart from the effect of accreditation on healthcare workers and particularly on job stress, our results indicate a consistent positive effect of hospital accreditation on safety culture, process-related performance measures, efficiency, and the patient length of stay, whereas employee satisfaction, patient satisfaction and experience, and 30-day hospital readmission rate were found to be unrelated to accreditation. Paradoxical results regarding the impact of accreditation on mortality rate and healthcare-associated infections hampered drawing firm conclusions on these outcome measures.

CONCLUSION

There is reasonable evidence to support the notion that compliance with accreditation standards has multiple plausible benefits in improving the performance in the hospital setting. Despite inconclusive evidence on causality, introducing hospital accreditation schemes stimulates performance improvement and patient safety. Efforts to incentivize and modernize accreditation are recommended to move towards institutionalization and sustaining the performance gains. PROSPERO registration number CRD42020167863.

Commentary: Improving the Sustainability of Healthcare in Canada through Physician-Engaged Delivery System Reforms

Increasing private healthcare financing has been suggested as a solution toward improving healthcare quality and access within the Canadian healthcare system. However, Lee et al. (2021) find no evidence that increasing private financing would address the challenges faced by Canadian healthcare. We suggest turning our focus away from reforms that solely increase private healthcare financing and toward evidence-based delivery-system reforms to address both quality and sustainability. We present examples and supporting evidence of the effectiveness of patient-, physician-, organization- and system-level strategies. Changes should engage physicians and be implemented across Canada to facilitate a cultural shift toward experimentation and high-value care delivery.

Hospital managers' perspectives with implementing quality improvement measures and a new regulatory framework: a qualitative case study

A new regulatory framework to support local quality and safety efforts in hospitals was introduced to the Norwegian healthcare system in 2017. This study aimed to investigate hospital managers' perspectives on implementation efforts and the resulting work practices, to understand if, and how, the new Quality Improvement Regulation influenced quality and safety improvement activities.

DESIGN

This article reports one study level (the perspectives of hospital managers), as part of a multilevel case study. Data were collected by interviews and analysed according to qualitative content analysis.

SETTING

Three hospitals retrieved from two regional health trusts in Norway.

PARTICIPANTS

20 hospital managers or quality advisers selected from different levels of hospital organisations.

RESULTS

Four themes were identified in response to the study aim: (1) adaptive capacity in hospital management and practice, (2) implementation efforts and challenges with quality improvement, (3) systemic changes and (4) the potential to learn. Recent structural and cultural changes to, and development of, quality improvement systems in hospitals were discovered (3). Participants however, revealed no change in their practice solely due to the new Quality Improvement Regulation (2). Findings indicated that hospital managers are legally responsible for quality improvement implementation and participants described several benefits with the new Quality Improvement Regulation (2). This related to adaptation and flexibility to local context, and clinical autonomy as an inevitable element in hospital practice (1). Trust and a safe work environment were described as key factors to achieve adverse event reporting and support learning processes (4).

CONCLUSIONS

This study suggests that a lack of time, competence and/or motivation, impacted hospitals' implementation of quality improvement efforts. Hospital managers' autonomy and adaptive capacity to tailor quality improvement efforts were key for the new Quality Improvement Regulation to have any relevant impact on hospital practice and for it to influence quality and safety improvement activities.

'I know those people will be approachable and not mistreat us': a qualitative study of inspectors and private drug sellers' views on peer supervision in rural Uganda

BACKGROUND

Peer supervision improves health care delivery by health workers. However, in rural Uganda, self-supervision is what is prescribed for licensed private drug sellers by statutory guidelines. Evidence shows that self-supervision encourages inappropriate treatment of children less than 5 years of age by private drug sellers. This study constructed a model for an appropriate peer supervisor to augment the self-supervision currently practiced by drug sellers at district level in rural Uganda.

METHODS

In this qualitative study, six Key informant interviews were held with inspectors while ten focus group discussions were conducted with 130 drug sellers. Data analysis was informed by the Kathy Charmaz constructive approach to grounded theory. Atlas ti.7 software package was used for data management.

RESULTS

A model with four dimensions defining an appropriate peer supervisor was developed. The dimensions included; incentives, clearly defined roles, mediation and role model peer supervisor. While all dimensions were regarded as being important, all participants interviewed agreed that incentives for peer supervisors were the most crucial. Overall, an appropriate peer supervisor was described as being exemplary to other drug sellers, operated within a defined framework, well facilitated to do their role and a good go-between drug sellers and government inspectors.

CONCLUSION

Four central contributions advance literature by the model developed by our study. First, the model fills a supervision gap for rural private drug sellers. Second, it highlights the need for terms of reference for peer supervisors. Third, it describes who an appropriate peer supervisor should be. Lastly, it elucidates the kind of resources needed for peer supervision.

Regulatory inspection of registered private drug shops in East-Central Uganda-what it is versus what it should be: a qualitative study

Background

Regulatory inspection of private drug shops in Uganda is a mandate of the Ministry of Health carried out by the National Drug Authority. This study evaluated how this mandate is being carried out at national, district, and drug shop levels. Specifically, perspectives on how the inspection is done, who does it, and challenges faced were sought from inspectors and drug sellers.

Methods

Six key informant interviews (KIIs) were held with inspectors at the national and district level, while eight focus group discussions (FGDs) were conducted among nursing assistants, and two FGDs were held with nurses. The study appraised current methods of inspecting drug sellers against national professional guidelines for licensing and renewal of class C drug shops in Uganda. Transcripts were managed using Atlas ti version 7 (ATLAS.ti GmbH, Berlin) data management software where the thematic content analysis was done.

Results

Five themes emerged from the study: authoritarian inspection, delegated inspection, licensing, training, and bribes. Under authoritarian inspection, drug sellers decried the high handedness used by inspectors when found with expired or no license at all. For delegated inspection, drug sellers said that sometimes, inspectors send health assistants and sub-county chiefs for inspection visits. This cadre of people is not recognized by law as inspectors. Inspectors trained drug sellers on how to organize their drug shops better and how to use new technologies such as rapid diagnostic tests (RDTs) in diagnosing malaria. Bribes were talked about mostly by nursing assistants who purported that inspectors were not interested in inspection per se but collecting illicit payments from them. Inspectors said that the facilitation they received from the central government were inadequate for a routine inspection.

Conclusion

The current method of inspecting drug sellers is harsh and instills fear among drug sellers. There is a need to establish a well-recognized structure of inspection as well as establish channels of dialogue between inspectors and drug sellers if meaningful compliance is to be achieved. The government also needs to enhance both human and financial resources if meaningful inspection of drug sellers is to take place.

Mediators of change in healthcare organisations subject to external assessment: a systematic review with narrative synthesis

OBJECTIVES

External inspections are widely used to improve the quality of care. The effects of inspections remain unclear and little is known about how they may work. We conducted a narrative synthesis of research literature to identify mediators of change in healthcare organisations subject to external inspections.

METHODS

We performed a literature search (1980-January 2020) to identify empirical studies addressing change in healthcare organisations subject to external inspection. Guided by the Consolidated Framework for Implementation Research, we performed a narrative synthesis to identify mediators of change.

RESULTS

We included 95 studies. Accreditation was the most frequent type of inspection (n=68), followed by statutory inspections (n=19), and external peer review (n=9). Our findings suggest that the regulatory context in which the inspections take place affect how they are acted on by those being inspected. The way inspections are conducted seem to be critical for how the inspection findings are perceived and followed up. Inspections can engage and involve staff, facilitate leader engagement, improve communication and enable the creation of new networks for reflection on clinical practice. Inspections can contribute to creating an awareness of the inspected organisation's current practice and performance gaps, and a commitment to change. Moreover, they can contribute to facilitating the planning and implementation of change, as well as self-evaluation and the use of data to evaluate performance.

CONCLUSIONS

External inspections can affect different mediators of organisational change. The way and to what extent they do depend on a range of factors related to the outer setting, the way inspections are conducted and how they are perceived and acted on by the inspected organisation. To improve the quality of care, the organisational change processes need to involve and impact the way care is delivered to the patients.

Publication and related bias in quantitative health services and delivery research: a multimethod study

Background

Bias in the publication and reporting of research findings (referred to as publication and related bias here) poses a major threat in evidence synthesis and evidence-based decision-making. Although this bias has been well documented in clinical research, little is known about its occurrence and magnitude in health services and delivery research.

Objectives

To obtain empirical evidence on publication and related bias in quantitative health services and delivery research; to examine current practice in detecting/mitigating this bias in health services and delivery research systematic reviews; and to explore stakeholders’ perception and experiences concerning such bias.

Methods

The project included five distinct but interrelated work packages. Work package 1 was a systematic review of empirical and methodological studies. Work package 2 involved a survey (meta-epidemiological study) of randomly selected systematic reviews of health services and delivery research topics (n = 200) to evaluate current practice in the assessment of publication and outcome reporting bias during evidence synthesis. Work package 3 included four case studies to explore the applicability of statistical methods for detecting such bias in health services and delivery research. In work package 4 we followed up four cohorts of health services and delivery research studies (total n = 300) to ascertain their publication status, and examined whether publication status was associated with statistical significance or perceived ‘positivity’ of study findings. Work package 5 involved key informant interviews with diverse health services and delivery research stakeholders (n = 24), and a focus group discussion with patient and service user representatives (n = 8).

Results

We identified only four studies that set out to investigate publication and related bias in health services and delivery research in work package 1. Three of these studies focused on health informatics research and one concerned health economics. All four studies reported evidence of the existence of this bias, but had methodological weaknesses. We also identified three health services and delivery research systematic reviews in which findings were compared between published and grey/unpublished literature. These reviews found that the quality and volume of evidence and effect estimates sometimes differed significantly between published and unpublished literature. Work package 2 showed low prevalence of considering/assessing publication (43%) and outcome reporting (17%) bias in health services and delivery research systematic reviews. The prevalence was lower among reviews of associations than among reviews of interventions. The case studies in work package 3 highlighted limitations in current methods for detecting these biases due to heterogeneity and potential confounders. Follow-up of health services and delivery research cohorts in work package 4 showed positive association between publication status and having statistically significant or positive findings. Diverse views concerning publication and related bias and insights into how features of health services and delivery research might influence its occurrence were uncovered through the interviews with health services and delivery research stakeholders and focus group discussion conducted in work package 5.

Conclusions

This study provided prima facie evidence on publication and related bias in quantitative health services and delivery research. This bias does appear to exist, but its prevalence and impact may vary depending on study characteristics, such as study design, and motivation for conducting the evaluation. Emphasis on methodological novelty and focus beyond summative assessments may mitigate/lessen the risk of such bias in health services and delivery research. Methodological and epistemological diversity in health services and delivery research and changing landscape in research publication need to be considered when interpreting the evidence. Collection of further empirical evidence and exploration of optimal health services and delivery research practice are required.

Study registration

This study is registered as PROSPERO CRD42016052333 and CRD42016052366.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 33. See the NIHR Journals Library website for further project information.

Experiences of accreditation impact in general practice - a qualitative study among general practitioners and their staff

BACKGROUND

Accreditation is a widespread tool for quality management in health care. However, there is lack of research on the impact of accreditation, particularly in general practice. This study explores how general practitioners and their staff experienced the impact of a mandatory accreditation program in Denmark.

METHODS

Qualitative interviews with general practitioners and staff from 11 clinics. The respondents were interviewed twice: during preparation and after the survey visit. The interviews were analyzed using thematic analysis, and all specific changes and other types of impact were extracted from the transcribed interview data from each clinic.

RESULTS

The impact of accreditation varied markedly among the clinics as did the participants' overall assessments of accreditation. Concerning specific changes in behavior and physical infrastructure, some clinics had only implemented a few minor changes in response to accreditation, some had made a relatively moderate number of changes, and a few clinics had made relatively many changes including a few pronounced ones. Further, some participants experienced that accreditation had enhanced knowledge sharing or upgraded competencies, and increased job satisfaction. However, the workload related to accreditation was emphasized as a problem by a majority of the professionals and for a few, accreditation had influenced job satisfaction negatively.

CONCLUSION

Accreditation may affect general practice clinics in very different ways. In spite of several examples of positive impact, the results suggest that it is difficult to design a mandatory accreditation program for general practice in which most professionals experience that the benefits of accreditation equal the resources used in the process.

Can hospital accreditation enhance patient experience? Longitudinal evidence from a Hong Kong hospital patient experience survey

BACKGROUND

Hospital accreditation is expected to improve health care quality and patient satisfaction. However, little and conflicting evidence is currently available to support its effect on patient outcomes, particularly patient experience. Hong Kong recently launched a pilot programme to test an infrastructure for accreditation of both private and public hospitals with the Australian Council on Healthcare Standards. This study aims to evaluate the longitudinal impact of hospital accreditation on patient experience in a publicly-funded university teaching hospital in Hong Kong.

METHODS

Three cross-sectional surveys were conducted at three time points: 9 months pre- accreditation as baseline (T1), three (T2) and fifteen months (T3) post-accreditation. Acute care inpatients aged 18 to 80 were recruited on the second day of hospital admission to complete the Picker Patient Experience Questionnaire-15 (PPE-15). Baseline data was first compared to the 2005 Hong Kong average for public hospitals using t-tests. Data was then analyzed using ANOVA and multiple linear regression to evaluate differences across the three cross-sections and examine the effect of accreditation over time while controlling for covariates.

RESULTS

3083 patients (T1 = 896, T2 = 1093, T3 = 1094) completed the survey for a response rate of 83.5, 86.1, and 83.8%, respectively. The hospital baseline domain and summary patient experience scores differed from the Hong Kong public hospital average obtained from the 2005 Thematic Household Survey. All domain and summary patient experience scores declined (improved) over the study period (T1 to T3). The multiple regression results confirmed the time point score comparisons with declining (improving) parameter estimates for T2 and T3 for all domain and summary scores except the 'continuity and transition' domain, for which the declining coefficient was only significant at T3.

CONCLUSIONS

While hospital accreditation has not been shown to improve patient outcomes, this study suggests the accreditation exercise may enhance patient experience. Moreover, it suggests the quality improvement initiatives associated with accreditation may address areas of concern emphasized by Hong Kong patients, such as involvement in care and emotional support from providers.

Primary health care quality indicators: An umbrella review

Nowadays, evaluating the quality of health services, especially in primary health care (PHC), is increasingly important. In a historical perspective, the Department of Health (United Kingdom) developed and proposed a range of indicators in 1998, and lately several health, social and political organizations have defined and implemented different sets of PHC quality indicators. Some systematic reviews in PHC quality indicators are reported but only in specific contexts and conditions. The aim of this study is to characterize and provide a list of indicators discussed in the literature to support managers and clinicians in decision-making processes, through an umbrella review on PHC quality indicators. The methodology was performed according to PRISMA Statement. Indicators from 33 eligible systematic reviews were categorized according to the dimensions of care, function, type of care, domains and condition contexts. Of a total of 727 indicators or groups of indicators, 74.5% (n = 542) were classified in process category and 89.5% (n = 537) with chronic type of care (n = 428; 58.8%) and effective domain (n = 423; 58.1%) with the most frequent values in categorizations by dimensions. The results of this overview of reviews are valuable and imply the need for future research and practice regarding primary health care quality indicators in the most varied conditions and contexts to generate new discussions about their use, comparison and implementation.

Patient safety regulation in the NHS: mapping the regulatory landscape of healthcare

OBJECTIVES

The current research project sought to map out the regulatory landscape for patient safety in the English National Health Service (NHS).

METHOD

We used a systematic desk-based search using a variety of sources to identify the total number of organisations with regulatory influence in the NHS; we researched publicly available documents listing external inspection agencies, participated in advisory consultations with NHS regulatory compliance teams and reviewed the websites of all regulatory agencies.

RESULTS

Our mapping revealed over 126 organisations who exert some regulatory influence on NHS provider organisations in addition to 211 Clinical Commissioning Groups. The majority of these organisations set standards and collect data from provider organisations and a considerable number carry out investigations. We found a multitude of overlapping functions and activities. The variability in approach and overlapping functions suggest that there is no overall integrated regulatory approach.

CONCLUSION

Regulation potentially provides a variety of benefits in terms of maintaining the safety and quality of care by providing an external perspective on the care being delivered. However, the variability, extent and fragmentation of the regulatory system of the NHS make it hard for regulators to act effectively and places a massive burden on NHS provider organisations. Overlapping regulatory requests may distract locally driven initiatives to improve safety and quality. Further research is needed to understand the full extent of regulatory activity and the true benefits and costs incurred.

The influence of hospital accreditation: a longitudinal assessment of organisational culture

BACKGROUND

A growing body of evidence supports the link between hospital organisational culture and health outcomes. Organisational culture is thus an essential consideration for hospital accreditation, a practice of systematically assessing the quality of hospital care against accepted standards. This study assesses the interplay between accreditation and hospital professional staff perception of organisational culture.

METHODS

A prospective cohort study design was used to explore the influence of accreditation on organisational culture within a large, publicly-funded, university teaching hospital in Hong Kong. All full-time hospital and academic physicians, nurses and allied health professionals were invited to participate. Organisational culture was evaluated using the Competing Values Framework through the Quality Improvement Implementation Survey. Organisational culture was assessed longitudinally at 9 months prior to accreditation, 3 months following and 15 months after accreditation. To capture potential shifts in staff perception of organisational culture through the accreditation process, we conducted a between time-point comparison using a linear trend model.

RESULTS

545 clinical staff completed the organisational culture survey pre-accreditation, 378 three- months post-accreditation and 141 15-months post-accreditation. Hierarchical culture was the dominant organisational culture domain pre-accreditation, followed by rational, developmental and group culture, respectively. Following accreditation, hierarchical culture declined but remained dominant, while group and developmental culture increased. However, the decline in hierarchical culture was U-shaped with scores increasing at 15-months post-accreditation, though not to pre-accreditation levels. When stratified by professional group, hierarchical culture declined following accreditation with corresponding increases in group culture and developmental culture among physicians and nurses, respectively. While allied health professionals did not perceive any significant cultural differences directly following accreditation, a significant increase in hierarchical culture and corresponding decrease in group culture was found 15-months post-accreditation.

CONCLUSIONS

This study suggests the hospital accreditation process may contribute to shifts in staff perception of organisational culture. Our findings also indicate differential views of organisational culture across professional groups. Finally, we note the striking dominance of hierarchical culture in this Hong Kong hospital across all time points, far surpassing other studies, even those in which hierarchical culture prevailed.

Recommendations to facilitate managers' compliance with quality standards at primary health care clinics

Background

The Republic of South Africa (RSA) is shifting towards universal health coverage and a unified health system. This milestone can be achieved through the implementation of National Health Insurance (NHI). To employ NHI, health establishments in the country are compelled to comply with quality standards. The non-compliance with quality standards at primary health care (PHC) clinics within a district in Gauteng, which was verified by quality standards’ audit reports, prompted an intervention. No prior research aimed at facilitating managers’ compliance with quality standards has been conducted within the context under study. This research gap necessitated an exploration on how managers’ compliance to quality standards at PHC clinics within a district in Gauteng could best be facilitated.

Objectives

To describe recommendations to facilitate managers’ compliance with quality standards at PHC clinics within a district in Gauteng.

Method

A qualitative, exploratory, descriptive and contextual research design was used in this study. Semi-structured, individual interviews were conducted.

Results

The recommendations to facilitate managers’ compliance with quality standards at PHC clinics within a district in Gauteng were described. However, for the purpose of this article, only the recommendations seeking to address challenges with management practices as a reason for non-compliance with quality standards at PHC clinics will be discussed. These recommendations include involvement of PHC clinic managers in decision-making, adequate support from senior management and improvement of internal communication practices.

Conclusion

The researcher concludes that the senior management team in the district under study should strive to embrace the described recommendations as a strategy to facilitate managers’ compliance to quality standards at PHC clinics.

Measurement and improvement of emergency department performance through inspection and rating: an observational study of emergency departments in acute hospitals in England

Introduction

Hospital inspection and the publication of inspection ratings are widely used regulatory interventions that may improve hospital performance by providing feedback, creating incentives to change and promoting choice. However, evidence that these interventions assess performance accurately and lead to improved performance is scarce.

Methods

We calculated six standard indicators of emergency department (ED) performance for 118 hospitals in England whose EDs were inspected by the Care Quality Commission, the national regulator in England, between 2013 and 2016. We linked these to inspection dates and subsequent rating scores. We used multilevel linear regression models to estimate the relationship between prior performance and subsequent rating score and the relationship between rating score and post-inspection performance.

Results

We found no relationship between performance on any of the six indicators prior to inspection and the subsequent rating score. There was no change in performance on any of the six indicators following inspection for any rating score. In each model, CIs were wide indicating no statistically significant relationships.

Discussion

We found no association between established performance indicators and rating scores. This might be because the inspection and rating process adds little to the external performance management that EDs receive. It could also indicate the limited ability of hospitals to improve ED performance because of extrinsic factors that are beyond their control.

Understanding accreditation standards in general practice - a qualitative study

Background

Accreditation is a widely adopted tool for quality control and quality improvement in health care, which has increasingly been employed for general practice. However, there is lack of knowledge of how accreditation is received and experienced by health professionals in general practice. This study explores how general practitioners (GPs) and their staff experienced the comprehensibility of accreditation standards and how they worked to increase their understanding of the standards. The study was conducted in Denmark where accreditation was mandatory in general practice from 2016 to 2018.

Methods

The study consists of qualitative interviews with general practitioners and staff from 11 general practices that were strategically sampled among practices set to receive their survey visit in 2017. Participants were interviewed twice; once during the preparation phase and once after the survey visit. GPs and staff were interviewed separately. The interviews were analysed inductively using thematic analysis.

Results

Understanding the requirements of the accreditation standards was a major challenge for the professionals when preparing for the accreditation survey visit. The participants attempted to increase their understanding of the standards in several ways including the use of regional support options and seeking out experts and colleagues. However, participants had mixed experiences with the various support options and many found the sense making work frustrating and time consuming.

Conclusion

The results point to the importance of considering the level of specificity in accreditation standards and how to ensure an organisational set-up that can offer appropriate support to primary care clinics in terms of understanding what is required to meet the standards.

Electronic supplementary material

The online version of this article (10.1186/s12875-019-0910-2) contains supplementary material, which is available to authorized users.

Improving the sustainability of hospital-based interventions: a study protocol for a systematic review

INTRODUCTION

Sustaining effective interventions in hospital environments is essential to improving health outcomes, and reducing research waste. Current evidence suggests many interventions are not sustained beyond their initial delivery. The reason for this failure remains unclear. Increasingly research is employing theoretical frameworks and models to identify critical factors that influence the implementation of interventions. However, little is known about the value of these frameworks on sustainability. The aim of this review is to examine the evidence regarding the use of theoretical frameworks to maximise effective intervention sustainability in hospital-based settings in order to better understand their role in supporting long-term intervention use.

METHODS AND ANALYSIS

Systematic review. We will systematically search the following databases: Medline, AMED, CINAHL, Embase and Cochrane Library (CENTRAL, CDSR, DARE, HTA). We will also hand search relevant journals and will check the bibliographies of all included studies. Language and date limitations will be applied. We will include empirical studies that have used a theoretical framework (or model) and have explicitly reported the sustainability of an intervention (or programme). One reviewer will remove obviously irrelevant titles. The remaining abstracts and full-text articles will be screened by two independent reviewers to determine their eligibility for inclusion. Disagreements will be resolved by discussion, and may involve a third reviewer if required. Key study characteristics will be extracted (study design, population demographics, setting, evidence of sustained change, use of theoretical frameworks and any barriers or facilitators data reported) by one reviewer and cross-checked by another reviewer. Descriptive data will be tabulated within evidence tables, and key findings will be brought together within a narrative synthesis.

ETHICS AND DISSEMINATION

Formal ethical approval is not required as no primary data will be collected. Dissemination of results will be through peer-reviewed journal publications, presentation at an international conference and social media.

PROSPERO REGISTRATION NUMBER

CRD42017081992.

A Critical Analysis of Purchasing Arrangements in Kenya: The Case of the National Hospital Insurance Fund

Background: Purchasing refers to the process by which pooled funds are paid to providers in order to deliver a set of health care interventions. Very little is known about purchasing arrangements in low- and middle-income countries (LMICs), and certainly not in Kenya. This study aimed to critically analyse purchasing arrangements in Kenya, using the National Hospital Insurance Fund (NHIF) as a case study.

Methods: We applied a principal-agent relationship framework, which identifies three pairs of principal-agent relationships (government-purchaser, purchaser-provider, and citizen-purchaser) and specific actions required within them to achieve strategic purchasing. A qualitative case study approach was applied. Data were collected through document reviews (statutes, policy and regulatory documents) and in-depth interviews (n=62) with key informants including NHIF officials, Ministry of Health (MoH) officials, insurance industry actors, and health service providers. Documents were summarised using standardised forms. Interviews were recorded, transcribed verbatim, and analysed using a thematic framework approach.

Results: The regulatory and policy framework for strategic purchasing in Kenya was weak and there was no clear accountability mechanism between the NHIF and the MoH. Accountability mechanisms within the NHIF have developed over time, but these emphasized financial performance over other aspects of purchasing. The processes for contracting, monitoring, and paying providers do not promote equity, quality, and efficiency. This was partly due to geographical distribution of providers, but also due to limited capacity within the NHIF. There are some mechanisms for assessing needs, preferences, and values to inform design of the benefit package, and while channels to engage beneficiaries exist, they do not always function appropriately and awareness of these channels to the beneficiaries is limited.

Conclusion: Addressing the gaps in the NHIF’s purchasing performance requires a number of approaches. Critically, there is a need for the government through the MoH to embrace its stewardship role in health, while recognizing the multiplicity of actors given Kenya’s devolved context. Relatively recent decentralisation reforms present an opportunity that should be grasped to rewrite the contract between the government, the NHIF and Kenyans in the pursuit of universal health coverage (UHC).

Developing online accreditation education resources for health care services: An Australian Case Study

Quality problem or issue

In 2013, 'National Safety and Quality Health Service Standards' accreditation became mandatory for most health care services in Australia. Developing and maintaining accreditation education is challenging for health care services, particularly those in regional and rural settings. With accreditation imminent, there was a need to support health care services through the process.

Initial assessment

A needs analysis identified limited availability of open access online resources for national accreditation education.

Choice of solution

A standardized set of online accreditation education resources was the agreed solution to assist regional and rural health care services meet compulsory requirements.

Implementation

Education resources were developed over 3 months with project planning, implementation and assessment based on a program logic model.

Evaluation

Resource evaluation was undertaken after the first 3 months of resource availability to establish initial usage and stakeholder perceptions. From 1 January 2015 to 31 March 2015, resource usage was 20 272, comprising 12 989 downloads, 3594 course completions and 3689 page views. Focus groups were conducted at two rural and one metropolitan hospital (n = 16), with rural hospitals reporting more benefits. Main user-based recommendations for future resource development were automatic access to customizable versions, ensuring suitability to intended audience, consistency between resource content and assessment tasks and availability of short and long length versions to meet differing users' needs.

Lessons learned

Further accreditation education resource development should continue to be collaborative, consider longer development timeframes and user-based recommendations.

An Analysis of Hospital Accreditation Policy in Iran

BACKGROUND

Public policymaking is complex and lacks research evidences, particularly in the Eastern Mediterranean Region (EMR). This policy analysis aims to generate insights about the process of hospital accreditation policy making in Iran, to identify factors influencing policymaking and to evaluate utilization of evidence in policy making process.

METHODS

The study examined the policymaking process using Walt and Gilson framework. A qualitative research design was employed. Thirty key informant interviews with policymakers and stakeholders were conducted. In addition hundred and five related documents were reviewed. Data was analyzed using framework analysis.

RESULTS

The accreditation program was a decision made at Ministry of Health and Medical Education in Iran. Many healthcare stakeholders were involved and evidence from leading countries was used to guide policy development. Poor hospital managers' commitment, lack of physicians' involvement and inadequate resources were the main barriers in policy implementation. Furthermore, there were too many accreditations standards and criteria, surveyors were not well-trained, had little motivation for their work and there was low consistency among them.

CONCLUSION

This study highlighted the complex nature of policymaking cycle and highlighted various factors influencing policy development, implementation and evaluation. An effective accreditation program requires a robust well-governed accreditation body, various stakeholders' involvement, sufficient resources and sustainable funds, enough human resources, hospital managers' commitment, and technical assistance to hospitals.

Governance arrangements for health systems in low-income countries: an overview of systematic reviews

BACKGROUND

Governance arrangements include changes in rules or processes that determine authority and accountability for health policies, organisations, commercial products and health professionals, as well as the involvement of stakeholders in decision-making. Changes in governance arrangements can affect health and related goals in numerous ways, generally through changes in authority, accountability, openness, participation and coherence. A broad overview of the findings of systematic reviews can help policymakers, their technical support staff and other stakeholders to identify strategies for addressing problems and improving the governance of their health systems.

OBJECTIVES

To provide an overview of the available evidence from up-to-date systematic reviews about the effects of governance arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on governance arrangements and informing refinements of the framework for governance arrangements outlined in the overview.

METHODS

We searched Health Systems Evidence in November 2010 and PDQ Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of governance arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use (health expenditures, healthcare provider costs, out-of-pocket payments, cost-effectiveness), healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty, employment) and that were published after April 2005. We excluded reviews with limitations that were important enough to compromise the reliability of the findings of the review. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.

MAIN RESULTS

We identified 7272 systematic reviews and included 21 of them in this overview (19 primary reviews and 2 supplementary reviews). We focus here on the results of the 19 primary reviews, one of which had important methodological limitations. The other 18 were reliable (with only minor limitations).We grouped the governance arrangements addressed in the reviews into five categories: authority and accountability for health policies (three reviews); authority and accountability for organisations (two reviews); authority and accountability for commercial products (three reviews); authority and accountability for health professionals (seven reviews); and stakeholder involvement (four reviews).Overall, we found desirable effects for the following interventions on at least one outcome, with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects. Decision-making about what is covered by health insurance- Placing restrictions on the medicines reimbursed by health insurance systems probably decreases the use of and spending on these medicines (moderate-certainty evidence). Stakeholder participation in policy and organisational decisions- Participatory learning and action groups for women probably improve newborn survival (moderate-certainty evidence).- Consumer involvement in preparing patient information probably improves the quality of the information and patient knowledge (moderate-certainty evidence). Disclosing performance information to patients and the public- Disclosing performance data on hospital quality to the public probably encourages hospitals to implement quality improvement activities (moderate-certainty evidence).- Disclosing performance data on individual healthcare providers to the public probably leads people to select providers that have better quality ratings (moderate-certainty evidence).

AUTHORS' CONCLUSIONS

Investigators have evaluated a wide range of governance arrangements that are relevant for low-income countries using sound systematic review methods. These strategies have been targeted at different levels in health systems, and studies have assessed a range of outcomes. Moderate-certainty evidence shows desirable effects (with no undesirable effects) for some interventions. However, there are important gaps in the availability of systematic reviews and primary studies for the all of the main categories of governance arrangements.

Effects of external inspection on sepsis detection and treatment: a study protocol for a quasiexperimental study with a stepped-wedge design

INTRODUCTION

Inspections are widely used in health care as a means to improve the health services delivered to patients. Despite their widespread use, there is little evidence of their effect. The mechanisms for how inspections can promote change are poorly understood. In this study, we use a national inspection campaign of sepsis detection and initial treatment in hospitals as case to: (1) Explore how inspections affect the involved organizations. (2) Evaluate what effect external inspections have on the process of delivering care to patients, measured by change in indicators reflecting how sepsis detection and treatment is carried out. (3) Evaluate whether external inspections affect patient outcomes, measured as change in the 30-day mortality rate and length of hospital stay.

METHODS AND ANALYSIS

The intervention that we study is inspections of sepsis detection and treatment in hospitals. The intervention will be rolled out sequentially during 12 months to 24 hospitals. Our effect measures are change on indicators related to the detection and treatment of sepsis, the 30-day mortality rate and length of hospital stay. We collect data from patient records at baseline, before the inspections, and at 8 and 14 months after the inspections. We use logistic regression models and linear regression models to compare the various effect measurements between the intervention and control periods. All the models will include time as a covariate to adjust for potential secular changes in the effect measurements during the study period. We collect qualitative data before and after the inspections, and we will conduct a thematic content analysis to explore how inspections affect the involved organisations.

ETHICS AND DISSEMINATION

The study has obtained ethical approval by the Regional Ethics Committee of Norway Nord and the Norwegian Data Protection Authority. It is registered at www.clinicaltrials.gov (Identifier: NCT02747121). Results will be reported in international peer-reviewed journals.

TRIAL REGISTRATION

NCT02747121; Pre-results.

Emerging hybridity: comparing UK healthcare regulatory arrangements

Purpose

Healthcare regulation is one means to address quality challenges in healthcare systems and is carried out using compliance, deterrence and/or improvement approaches. The four countries of the UK provide an opportunity to explore and compare different regulatory architecture and models. The purpose of this paper is to understand emerging regulatory models and associated tensions.

Design/methodology/approach

This paper uses qualitative methods to compare the regulatory architecture and models. Data were collected from documents, including board papers, inspection guidelines and from 48 interviewees representing a cross-section of roles from six organisational regulatory agencies. The data were analysed thematically using an a priori coding framework developed from the literature.

Findings

The findings show that regulatory agencies in the four countries of the UK have different approaches and methods of delivering their missions. This study finds that new hybrid regulatory models are developing which use improvement support interventions in parallel with deterrence and compliance approaches. The analysis highlights that effective regulatory oversight of quality is contingent on the ability of regulatory agencies to balance their requirements to assure and improve care. Nevertheless, they face common tensions in sustaining the balance in their requirements connected to their roles, relationships and resources.

Originality/value

The paper shows through its comparison of UK regulatory agencies that the development and implementation of hybrid models is complex. The paper contributes to research by identifying three tensions related to hybrid regulatory models; roles, resources and relationships which need to be managed to sustain hybrid regulatory models.

Understanding how and why audits work: protocol for a realist review of audit programmes to improve hospital care

INTRODUCTION

Many types of audits are commonly used in hospital care to promote quality improvements. However, the evidence on the effectiveness of audits is mixed. The objectives of this proposed realist review are (1) to understand how and why audits might, or might not, work in terms of delivering the intended outcome of improved quality of hospital care and (2) to examine under what circumstances audits could potentially be effective. This protocol will provide the rationale for using a realist review approach and outline the method.

METHODS AND ANALYSIS

This review will be conducted using an iterative four-stage approach. The first and second steps have already been executed. The first step was to develop an initial programme theory based on the literature that explains how audits are supposed to work. Second, a systematic literature search was conducted using relevant databases. Third, data will be extracted and coded for concepts relating to context, outcomes and their interrelatedness. Finally, the data will be synthesised in a five-step process: (1) organising the extracted data into evidence tables, (2) theming, (3) formulating chains of inference from the identified themes, (4) linking the chains of inference and formulating CMO configurations and (5) refining the initial programme theory. The reporting of the review will follow the 'Realist and Meta-Review Evidence Synthesis: Evolving Standards' (RAMESES) publication standards.

ETHICS AND DISSEMINATION

This review does not require formal ethical approval. A better understanding of how and why these audits work, and how context impacts their effectiveness, will inform stakeholders in deciding how to tailor and implement audits within their local context. We will use a range of dissemination strategies to ensure that findings from this realist review are broadly disseminated to academic and non-academic audiences.

PROSPERO REGISTRATION NUMBER

CRD42016039882.

Revalidation and quality assurance: the application of the MUSIQ framework in independent verification visits to healthcare organisations

OBJECTIVES

We present a national evaluation of the impact of independent verification visits (IVVs) performed by National Health Service (NHS) England as part of quality assuring medical revalidation. Organisational visits are central to NHS quality assurance. They are costly, yet little empirical research evidence exists concerning their impact, and what does exist is conflicting.

SETTING

The focus was on healthcare providers in the NHS (in secondary care) and private sector across England, who were designated bodies (DBs). DBs are healthcare organisations that have a statutory responsibility, via the lead clinician, the responsible officer (RO), to implement medical revalidation.

PARTICIPANTS

All ROs who had undergone an IVV in England in 2014 and 2015 were invited to participate. 46 ROs were interviewed. Ethnographic data were gathered at 18 observations of the IVVs and 20 IVV post visit reports underwent documentary analysis.

PRIMARY AND SECONDARY OUTCOME MEASURES

Primary outcomes were the findings pertaining to the effectiveness of the IVV system in supporting the revalidation processes at the DBs. Secondary outcomes were methodological, relating to the Model for Understanding Success in Quality (MUSIQ) and how its application to the IVV reveals the relevance of contextual factors described in the model.

RESULTS

The impact of the IVVs varied by DB according to three major themes: the personal context of the RO; the organisational context of the DB; and the visit and its impact. ROs were largely satisfied with visits which raised the status of appraisal within their organisations. Inadequate or untimely feedback was associated with dissatisfaction.

CONCLUSIONS

Influencing teams whose prime responsibility is establishing processes and evaluating progress was crucial for internal quality improvement. Visits acted as a nudge, generating internal quality review, which was reinforced by visit teams with relevant expertise. Diverse team membership, knowledge transfer and timely feedback made visits more impactful.

Accreditation in general practice in Denmark: study protocol for a cluster-randomized controlled trial

Background

Accreditation is used increasingly in health systems worldwide. However, there is a lack of evidence on the effects of accreditation, particularly in general practice. In 2016 a mandatory accreditation scheme was initiated in Denmark, and during a 3-year period all practices, as default, should undergo accreditation according to the Danish Healthcare Quality Program. The aim of this study is primarily to evaluate the effects of a mandatory accreditation scheme.

Methods/design

The study is conducted as a cluster-randomized controlled trial among 1252 practices (clusters) with 2211 general practitioners in Denmark. Practices allocated to accreditation in 2016 serve as the intervention group, and practices allocated to accreditation in 2018 serve as controls. The selected outcomes should meet the following criteria: (1) a high degree of clinical relevance; (2) the possibility to assess changes due to accreditation; (3) availability of data from registers with no self-reporting data. The primary outcome is the number of prescribed drugs in patients older than 65 years. Secondary outcomes are changes in outcomes related to other perspectives of safe medication, good clinical practice and mortality. All outcomes relate to quality indicators included in the Danish Healthcare Quality Program, which is based on general principles for accreditation.

Discussion

The consequences of accreditation and standard-setting processes are generally under-researched, particularly in general practice. This is the largest study in general practice with a randomized implementation approach to evaluate the clinical effects of a nation-wide mandatory accreditation scheme in general practice.

Trial registration

ClinicalTrials.gov, NCT02762240. Registered on 24 May 2016.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-017-1818-6) contains supplementary material, which is available to authorized users.

External inspection of compliance with standards for improved healthcare outcomes

BACKGROUND

Inspection systems are used in healthcare to promote quality improvements (i.e. to achieve changes in organisational structures or processes, healthcare provider behaviour and patient outcomes). These systems are based on the assumption that externally promoted adherence to evidence-based standards (through inspection/assessment) will result in higher quality of healthcare. However, the benefits of external inspection in terms of organisational-, provider- and patient-level outcomes are not clear. This is the first update of the original Cochrane review, published in 2011.

OBJECTIVES

To evaluate the effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour and patient outcomes.

SEARCH METHODS

We searched the following electronic databases for studies up to 1 June 2015: the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, Database of Abstracts of Reviews of Effectiveness, HMIC, ClinicalTrials.gov and the World Health Organization International Clinical Trials Registry Platform. There was no language restriction and we included studies regardless of publication status. We also searched the reference lists of included studies and contacted authors of relevant papers, accreditation bodies and the International Organization for Standardization (ISO), regarding any further published or unpublished work. We also searched an online database of systematic reviews (PDQ-evidence.org).

SELECTION CRITERIA

We included randomised controlled trials (RCTs), non-randomised trials (NRCTs), interrupted time series (ITSs) and controlled before-after studies (CBAs) evaluating the effect of external inspection against external standards on healthcare organisation change, healthcare professional behaviour or patient outcomes in hospitals, primary healthcare organisations and other community-based healthcare organisations.

DATA COLLECTION AND ANALYSIS

Two review authors independently applied eligibility criteria, extracted data and assessed the risk of bias of each included study. Since meta-analysis was not possible, we produced a narrative results summary. We used the GRADE tool to assess the certainty of the evidence.

MAIN RESULTS

We did not identify any new eligible studies in this update. One cluster RCT involving 20 South African public hospitals and one ITS involving all acute hospital trusts in England, met the inclusion criteria. A trust is a National Health Service hospital which has opted to withdraw from local authority control and be managed by a trust instead.The cluster RCT reported mixed effects of external inspection on compliance with COHSASA (Council for Health Services Accreditation for South Africa) accreditation standards and eight indicators of hospital quality. Improved total compliance score with COHSASA accreditation standards was reported for 21/28 service elements: mean intervention effect was 30% (95% confidence interval (CI) 23% to 37%) (P < 0.001). The score increased from 48% to 78% in intervention hospitals, while remaining the same in control hospitals (43%). The median intervention effect for the indicators of hospital quality of care was 2.4% (range -1.9% to +11.8%).The ITS study evaluated compliance with policies to address healthcare-acquired infections and reported a mean reduction in MRSA (methicillin-resistant Staphylococcus aureus) infection rates of 100 cases per quarter (95% CI -221.0 to 21.5, P = 0.096) at three months' follow-up and an increase of 70 cases per quarter (95% CI -250.5 to 391.0; P = 0.632) at 24 months' follow-up. Regression analysis showed similar MRSA rates before and after the external inspection (difference in slope 24.27, 95% CI -10.4 to 58.9; P = 0.147).Neither included study reported data on unanticipated/adverse consequences or economic outcomes. The cluster RCT reported mainly outcomes related to healthcare organisation change, and no patient reported outcomes other than patient satisfaction.The certainty of the included evidence from both studies was very low. It is uncertain whether external inspection accreditation programmes lead to improved compliance with accreditation standards. It is also uncertain if external inspection infection programmes lead to improved compliance with standards, and if this in turn influences healthcare-acquired MRSA infection rates.

AUTHORS' CONCLUSIONS

The review highlights the paucity of high-quality controlled evaluations of the effectiveness and the cost-effectiveness of external inspection systems. If policy makers wish to understand the effectiveness of this type of intervention better, there needs to be further studies across a range of settings and contexts and studies reporting outcomes important to patients.

Evidence-based interventions to reduce adverse events in hospitals: a systematic review of systematic reviews

OBJECTIVE

To provide an overview of effective interventions aimed at reducing rates of adverse events in hospitals.

DESIGN

Systematic review of systematic reviews.

DATA SOURCES

PubMed, CINAHL, PsycINFO, the Cochrane Library and EMBASE were searched for systematic reviews published until October 2015.

STUDY SELECTION

English-language systematic reviews of interventions aimed at reducing adverse events in hospitals, including studies with an experimental design and reporting adverse event rates, were included. Two reviewers independently assessed each study's quality and extracted data on the study population, study design, intervention characteristics and adverse patient outcomes.

RESULTS

Sixty systematic reviews with moderate to high quality were included. Statistically significant pooled effect sizes were found for 14 types of interventions, including: (1) multicomponent interventions to prevent delirium; (2) rapid response teams to reduce cardiopulmonary arrest and mortality rates; (3) pharmacist interventions to reduce adverse drug events; (4) exercises and multicomponent interventions to prevent falls; and (5) care bundle interventions, checklists and reminders to reduce infections. Most (82%) of the significant effect sizes were based on 5 or fewer primary studies with an experimental study design.

CONCLUSIONS

The evidence for patient-safety interventions implemented in hospitals worldwide is weak. The findings address the need to invest in high-quality research standards in order to identify interventions that have a real impact on patient safety. Interventions to prevent delirium, cardiopulmonary arrest and mortality, adverse drug events, infections and falls are most effective and should therefore be prioritised by clinicians.

A retrospective review of how nonconformities are expressed and finalized in external inspections of health-care facilities

BACKGROUND

External inspections are widely used in health care as a means of improving the quality of care. However, the way external inspections affect the involved organization is poorly understood. A better understanding of these processes is important to improve our understanding of the varying effects of external inspections in different organizations. In turn, this can contribute to the development of more effective ways of conducting inspections. The way the inspecting organization states their grounds for noncompliant behavior and subsequently follows up to enforce the necessary changes can have implications for the inspected organization's change process. We explore how inspecting organizations express and state their grounds for noncompliant behavior and how they follow up to enforce improvements.

METHODS

We conducted a retrospective review, in which we performed a content analysis of the documents from 36 external inspections in Norway. Our analysis was guided by Donabedian's structure, process, and outcome model.

RESULTS

Deficiencies in the management system in combination with clinical work processes was considered as nonconformity by the inspecting organizations. Two characteristic patterns were identified in the way observations led to a statement of nonconformity: one in which it was clearly demonstrated how deficiencies in the management system could affect clinical processes, and one in which this connection was not demonstrated. Two characteristic patterns were also identified in the way the inspecting organization followed up and finalized their inspection: one in which the inspection was finalized solely based on the documented changes in structural deficiencies addressed in the nonconformity statement, and one based on the documented changes in structural and process deficiencies addressed in the nonconformity statement.

CONCLUSION

External inspections are performed to improve the quality of care. To accomplish this aim, we suggest that nonconformities should be grounded by observations that clearly demonstrate how deficiencies in the management system might affect the clinical processes, and that the inspection should be finalized based on documented changes in both structural and process deficiencies addressed in the nonconformity statement.

Development and application of an indicator assessment tool for measuring health services accreditation programs

Background

Hospital accreditation programs are internationally widespread and consume increasingly scarce health resources. However, we lack tools to consistently identify suitable indicators to assess and monitor accreditation outcomes. We describe the development and validation of such a tool.

Results

Using Australian accreditation standards as our reference point we: reviewed the research evidence for potential indicators; looked for links with existing external indicators; and assessed relevant state and federal policies. We allocated provisional scores, on a five point Likert scale, to the five accountability criteria in the tool: research; accuracy; proximity; no adverse effects; and specificity. An expert panel validated the use of the purpose designed indicator assessment tool. The panel identified hand hygiene compliance rates as a suitable process indicator, and hospital acquired Staphylococcus aureus infection (SAB) rates as an outcome indicator, with the hypothesis that improved hand hygiene compliance rates and lower SAB rates would correlate with accreditation performance.

Conclusions

This new tool can be used to identify, analyse, and compare accreditation indicators. Using infection control indicators such as hand hygiene compliance and SAB rates to measure accreditation effectiveness has merit, and their efficacy can be determined by comparing accreditation scores with indicator outcomes. To verify the tool as a robust instrument, testing is needed in other health service domains, both in Australia and internationally. This tool provides health policy makers with an important means for assessing the accreditation programs which form a critical part of the national patient safety and quality framework.

Accreditation and improvement in process quality of care: a nationwide study

OBJECTIVE

To examine whether performance measures improve more in accredited hospitals than in non-accredited hospital.

DESIGN AND SETTING

A historical follow-up study was performed using process of care data from all public Danish hospitals in order to examine the development over time in performance measures according to participation in accreditation programs.

PARTICIPANTS

All patients admitted for acute stroke, heart failure or ulcer at Danish hospitals.

INTERVENTION

Hospital accreditation by either The Joint Commission International or The Health Quality Service.

MEASUREMENTS

The primary outcome was a change in opportunity-based composite score and the secondary outcome was a change in all-or-none scores, both measures were based on the individual processes of care. These processes included seven processes related to stroke, six processes to heart failure, four to bleeding ulcer and four to perforated ulcer.

RESULTS

A total of 27 273 patients were included. The overall opportunity-based composite score improved for both non-accredited and accredited hospitals (13.7% [95% CI 10.6; 16.8] and 9.9% [95% 5.4; 14.4], respectively), but the improvements were significantly higher for non-accredited hospitals (absolute difference: 3.8% [95% 0.8; 8.3]). No significant differences were found at disease level. The overall all-or-none score increased significantly for non-accredited hospitals, but not for accredited hospitals. The absolute difference between improvements in the all-or-none score at non-accredited and accredited hospitals was not significant (3.2% [95% -3.6:9.9]).

CONCLUSIONS

Participating in accreditation was not associated with larger improvement in performance measures for acute stroke, heart failure or ulcer.

A systematic review of hospital accreditation: the challenges of measuring complex intervention effects

Background

The increased international focus on improving patient outcomes, safety and quality of care has led stakeholders, policy makers and healthcare provider organizations to adopt standardized processes for evaluating healthcare organizations. Accreditation and certification have been proposed as interventions to support patient safety and high quality healthcare. Guidelines recommend accreditation but are cautious about the evidence, judged as inconclusive. The push for accreditation continues despite sparse evidence to support its efficiency or effectiveness.

Methods

We searched MEDLINE, EMBASE and The Cochrane Library using Medical Subject Headings (MeSH) indexes and keyword searches in any language. Studies were assessed using the Cochrane Risk of Bias Tool and AMSTAR framework. 915 abstracts were screened and 20 papers were reviewed in full in January 2013. Inclusion criteria included studies addressing the effect of hospital accreditation and certification using systematic reviews, randomized controlled trials, observational studies with a control group, or interrupted time series. Outcomes included both clinical outcomes and process measures. An updated literature search in July 2014 identified no new studies.

Results

The literature review uncovered three systematic reviews and one randomized controlled trial. The lone study assessed the effects of accreditation on hospital outcomes and reported inconsistent results. Excluded studies were reviewed and their findings summarized.

Conclusion

Accreditation continues to grow internationally but due to scant evidence, no conclusions could be reached to support its effectiveness. Our review did not find evidence to support accreditation and certification of hospitals being linked to measurable changes in quality of care as measured by quality metrics and standards. Most studies did not report intervention context, implementation, or cost. This might reflect the challenges in assessing complex, heterogeneous interventions such as accreditation and certification. It is also may be magnified by the impact of how accreditation is managed and executed, and the varied financial and organizational healthcare constraints. The strategies hospitals should impelment to improve patient safety and organizational outcomes related to accreditation and certification components remains unclear.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-015-0933-x) contains supplementary material, which is available to authorized users.

The influence of context on the effectiveness of hospital quality improvement strategies: a review of systematic reviews

Background

It is now widely accepted that the mixed effect and success rates of strategies to improve quality and safety in health care are in part due to the different contexts in which the interventions are planned and implemented. The objectives of this study were to (i) describe the reporting of contextual factors in the literature on the effectiveness of quality improvement strategies, (ii) assess the relationship between effectiveness and contextual factors, and (iii) analyse the importance of contextual factors.

Methods

We conducted an umbrella review of systematic reviews searching the following databases: PubMed, Cochrane Database of Systematic Reviews, Embase and CINAHL. The search focused on quality improvement strategies included in the Cochrane Effective Practice and Organisation of Care Group taxonomy. We extracted data on quality improvement effectiveness and context factors. The latter were categorized according to the Model for Understanding Success in Quality tool.

Results

We included 56 systematic reviews in this study of which only 35 described contextual factors related with the effectiveness of quality improvement interventions. The most frequently reported contextual factors were: quality improvement team (n = 12), quality improvement support and capacity (n = 11), organization (n = 9), micro-system (n = 8), and external environment (n = 4). Overall, context factors were poorly reported. Where they were reported, they seem to explain differences in quality improvement effectiveness; however, publication bias may contribute to the observed differences.

Conclusions

Contextual factors may influence the effectiveness of quality improvement interventions, in particular at the level of the clinical micro-system. Future research on the implementation and effectiveness of quality improvement interventions should emphasize formative evaluation to elicit information on context factors and report on them in a more systematic way in order to better appreciate their relative importance.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-015-0906-0) contains supplementary material, which is available to authorized users.

Organization and evaluation of generalist palliative care in a Danish hospital

BACKGROUND

Hospitals have a responsibility to ensure that palliative care is provided to all patients with life-threatening illnesses. Generalist palliative care should therefore be acknowledged and organized as a part of the clinical tasks. However, little is known about the organization and evaluation of generalist palliative care in hospitals. Therefore the aim of the study was to investigate the organization and evaluation of generalist palliative care in a large regional hospital by comparing results from existing evaluations.

METHODS

Results from three different data sets, all aiming to evaluate generalist palliative care, were compared retrospectively. The data-sets derived from; 1. a national accreditation of the hospital, 2. a national survey and 3. an internal self-evaluation performed in the hospital. The data were triangulated to investigate the organization and evaluation of palliative care in order to identify concordances and/or discrepancies.

RESULTS

The triangulation indicated poor validity of the results from existing methods used to evaluate palliative care in hospitals. When the datasets were compared, several discrepancies occurred with regard to the organization and the performance of generalist palliative care. Five types of discrepancies were found in 35 out of 56 sections in the fulfilment of the national accreditation standard for palliative care. Responses from the hospital management and the department managements indicated that generalist palliative care was organized locally--if at all--within the various departments and with no overall structure or policy.

CONCLUSIONS

This study demonstrates weaknesses in the existing evaluation methods for generalist palliative care and highlights the lack of an overall policy, organization and goals for the provision of palliative care in the hospital. More research is needed to focus on the organization of palliative care and to establish indicators for high quality palliative care provided by the hospital. The lack of valid indicators, both for the hospital's and the departments' provision of palliative care, calls for more qualitative insight in the clinical staff's daily work including their culture and acceptance of the provision of palliative care.

Perceptions of quality in primary health care: perspectives of patients and professionals based on focus group discussions

Background

The EUprimecare project-team assessed the perception of primary health care (PHC) professionals and patients on quality of organization of PHC systems in the participating countries: Estonia, Finland, Germany, Hungary, Italy, Lithuania and Spain. This article presents the aggregated opinions, expectations and priorities of patients and professionals along some main dimensions of quality in primary health care, such as access, equity, appropriateness and patient- centeredness.

Methods

The focus group technique was applied in the study as a qualitative research method for exploration of attitudes regarding the health care system and health service. Discussions were addressing the topics of: general aspects of quality in primary health care; possibilities to receive/provide PHC services based on both parties needs; determinant factors of accessibility to PHC services; patient centeredness. The data sets collected during the focus group discussions were evaluated using the method of thematic analysis.

Results

There were 14 focus groups in total: a professional and a patient group in each of the seven partner countries. Findings of the thematic analysis were summarized along the following dimensions: access and equity, appropriateness (coordination, continuity, competency and comprehensiveness) and patient centeredness.

Conclusions

This study shows perceptions and views of patients in interaction with PHC and opinion of professionals working in PHC. It serves as source of criteria with relevance to everyday practice and experience. The criteria mentioned by patients and by health care professionals which were considered determining factors of the quality in primary care were quite similar among the investigated countries. However, the perception and the level of tolerance regarding some of the criteria differed among EUprimecare countries. Among these dissimilar criteria we especially note the gate-keeping role of GPs, the importance of nurses' competency and the acceptance of waiting times. The impact of waiting time on patient satisfaction is obvious; the influence of equity and access to PHC services are more dependent on the equal distribution of settings and doctors in urban and rural area. Foreseen shortage of doctors is expected to have a substantial influence on patient satisfaction in the near future.

Interventions to improve safe and effective medicines use by consumers: an overview of systematic reviews

BACKGROUND

Many systematic reviews exist on interventions to improve safe and effective medicines use by consumers, but research is distributed across diseases, populations and settings. The scope and focus of such reviews also vary widely, creating challenges for decision-makers seeking to inform decisions by using the evidence on consumers' medicines use.This is an update of a 2011 overview of systematic reviews, which synthesises the evidence, irrespective of disease, medicine type, population or setting, on the effectiveness of interventions to improve consumers' medicines use.

OBJECTIVES

To assess the effects of interventions which target healthcare consumers to promote safe and effective medicines use, by synthesising review-level evidence.

SEARCH METHODS

We included systematic reviews published on the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects. We identified relevant reviews by handsearching databases from their start dates to March 2012.

SELECTION CRITERIA

We screened and ranked reviews based on relevance to consumers' medicines use, using criteria developed for this overview.

DATA COLLECTION AND ANALYSIS

We used standardised forms to extract data, and assessed reviews for methodological quality using the AMSTAR tool. We used standardised language to summarise results within and across reviews; and gave bottom-line statements about intervention effectiveness. Two review authors screened and selected reviews, and extracted and analysed data. We used a taxonomy of interventions to categorise reviews and guide syntheses.

MAIN RESULTS

We included 75 systematic reviews of varied methodological quality. Reviews assessed interventions with diverse aims including support for behaviour change, risk minimisation and skills acquisition. No reviews aimed to promote systems-level consumer participation in medicines-related activities. Medicines adherence was the most frequently-reported outcome, but others such as knowledge, clinical and service-use outcomes were also reported. Adverse events were less commonly identified, while those associated with the interventions themselves, or costs, were rarely reported.Looking across reviews, for most outcomes, medicines self-monitoring and self-management programmes appear generally effective to improve medicines use, adherence, adverse events and clinical outcomes; and to reduce mortality in people self-managing antithrombotic therapy. However, some participants were unable to complete these interventions, suggesting they may not be suitable for everyone.Other promising interventions to improve adherence and other key medicines-use outcomes, which require further investigation to be more certain of their effects, include:· simplified dosing regimens: with positive effects on adherence;· interventions involving pharmacists in medicines management, such as medicines reviews (with positive effects on adherence and use, medicines problems and clinical outcomes) and pharmaceutical care services (consultation between pharmacist and patient to resolve medicines problems, develop a care plan and provide follow-up; with positive effects on adherence and knowledge).Several other strategies showed some positive effects, particularly relating to adherence, and other outcomes, but their effects were less consistent overall and so need further study. These included:· delayed antibiotic prescriptions: effective to decrease antibiotic use but with mixed effects on clinical outcomes, adverse effects and satisfaction;· practical strategies like reminders, cues and/or organisers, reminder packaging and material incentives: with positive, although somewhat mixed effects on adherence;· education delivered with self-management skills training, counselling, support, training or enhanced follow-up; information and counselling delivered together; or education/information as part of pharmacist-delivered packages of care: with positive effects on adherence, medicines use, clinical outcomes and knowledge, but with mixed effects in some studies;· financial incentives: with positive, but mixed, effects on adherence.Several strategies also showed promise in promoting immunisation uptake, but require further study to be more certain of their effects. These included organisational interventions; reminders and recall; financial incentives; home visits; free vaccination; lay health worker interventions; and facilitators working with physicians to promote immunisation uptake. Education and/or information strategies also showed some positive but even less consistent effects on immunisation uptake, and need further assessment of effectiveness and investigation of heterogeneity.There are many different potential pathways through which consumers' use of medicines could be targeted to improve outcomes, and simple interventions may be as effective as complex strategies. However, no single intervention assessed was effective to improve all medicines-use outcomes across all diseases, medicines, populations or settings.Even where interventions showed promise, the assembled evidence often only provided part of the picture: for example, simplified dosing regimens seem effective for improving adherence, but there is not yet sufficient information to identify an optimal regimen.In some instances interventions appear ineffective: for example, the evidence suggests that directly observed therapy may be generally ineffective for improving treatment completion, adherence or clinical outcomes.In other cases, interventions may have variable effects across outcomes. As an example, strategies providing information or education as single interventions appear ineffective to improve medicines adherence or clinical outcomes, but may be effective to improve knowledge; an important outcome for promoting consumers' informed medicines choices.Despite a doubling in the number of reviews included in this updated overview, uncertainty still exists about the effectiveness of many interventions, and the evidence on what works remains sparse for several populations, including children and young people, carers, and people with multimorbidity.

AUTHORS' CONCLUSIONS

This overview presents evidence from 75 reviews that have synthesised trials and other studies evaluating the effects of interventions to improve consumers' medicines use.Systematically assembling the evidence across reviews allows identification of effective or promising interventions to improve consumers' medicines use, as well as those for which the evidence indicates ineffectiveness or uncertainty.Decision makers faced with implementing interventions to improve consumers' medicines use can use this overview to inform decisions about which interventions may be most promising to improve particular outcomes. The intervention taxonomy may also assist people to consider the strategies available in relation to specific purposes, for example, gaining skills or being involved in decision making. Researchers and funders can use this overview to identify where more research is needed and assess its priority. The limitations of the available literature due to the lack of evidence for important outcomes and important populations, such as people with multimorbidity, should also be considered in practice and policy decisions.

DUQuE quality management measures: associations between quality management at hospital and pathway levels

Objective

The assessment of integral quality management (QM) in a hospital requires measurement and monitoring from different perspectives and at various levels of care delivery. Within the DUQuE project (Deepening our Understanding of Quality improvement in Europe), seven measures for QM were developed. This study investigates the relationships between the various quality measures.

Design

It is a multi-level, cross-sectional, mixed-method study.

Setting and Participants

As part of the DUQuE project, we invited a random sample of 74 hospitals in 7 countries. The quality managers of these hospitals were the main respondents. Furthermore, data of site visits of external surveyors assessing the participating hospitals were used.

Main Outcome Measures

Three measures of QM at hospitals level focusing on integral systems (QMSI), compliance with the Plan-Do-Study-Act quality improvement cycle (QMCI) and implementation of clinical quality (CQII). Four measures of QM activities at care pathway level focusing on Specialized expertise and responsibility (SER), Evidence-based organization of pathways (EBOP), Patient safety strategies (PSS) and Clinical review (CR).

Results

Positive significant associations were found between the three hospitals level QM measures. Results of the relationships between levels were mixed and showed most associations between QMCI and department-level QM measures for all four types of departments. QMSI was associated with PSS in all types of departments.

Conclusion

By using the seven measures of QM, it is possible to get a more comprehensive picture of the maturity of QM in hospitals, with regard to the different levels and across various types of hospital departments.

Increasing chlamydia screening tests in general practice: a modified Zelen prospective Cluster Randomised Controlled Trial evaluating a complex intervention based on the Theory of Planned Behaviour

OBJECTIVE

To determine if a structured complex intervention increases opportunistic chlamydia screening testing of patients aged 15-24 years attending English general practitioner (GP) practices.

METHODS

A prospective, Cluster Randomised Controlled Trial with a modified Zelen design involving 160 practices in South West England in 2010. The intervention was based on the Theory of Planned Behaviour (TPB). It comprised of practice-based education with up to two additional contacts to increase the importance of screening to GP staff and their confidence to offer tests through skill development (including videos). Practical resources (targets, posters, invitation cards, computer reminders, newsletters including feedback) aimed to actively influence social cognitions of staff, increasing their testing intention.

RESULTS

Data from 76 intervention and 81 control practices were analysed. In intervention practices, chlamydia screening test rates were 2.43/100 15-24-year-olds registered preintervention, 4.34 during intervention and 3.46 postintervention; controls testing rates were 2.61/100 registered patients prior intervention, 3.0 during intervention and 2.82 postintervention. During the intervention period, testing in intervention practices was 1.76 times as great (CI 1.24 to 2.48) as controls; this persisted for 9 months postintervention (1.57 times as great, CI 1.27 to 2.30). Chlamydia infections detected increased in intervention practices from 2.1/1000 registered 15-24-year-olds prior intervention to 2.5 during the intervention compared with 2.0 and 2.3/1000 in controls (Estimated Rate Ratio intervention versus controls 1.4 (CI 1.01 to 1.93).

CONCLUSIONS

This complex intervention doubled chlamydia screening tests in fully engaged practices. The modified Zelen design gave realistic measures of practice full engagement (63%) and efficacy of this educational intervention in general practice; it should be used more often.

TRIAL REGISTRATION

The trial was registered on the UK Clinical Research Network Study Portfolio database. UKCRN number 9722.

Strengthening integrated primary health care in Sofala, Mozambique

Background

Large increases in health sector investment and policies favoring upgrading and expanding the public sector health network have prioritized maternal and child health in Mozambique and, over the past decade, Mozambique has achieved substantial improvements in maternal and child health indicators. Over this same period, the government of Mozambique has continued to decentralize the management of public sector resources to the district level, including in the health sector, with the aim of bringing decision-making and resources closer to service beneficiaries. Weak district level management capacity has hindered the decentralization process, and building this capacity is an important link to ensure that resources translate to improved service delivery and further improvements in population health. A consortium of the Ministry of Health, Health Alliance International, Eduardo Mondlane University, and the University of Washington are implementing a health systems strengthening model in Sofala Province, central Mozambique.

Description of implementation

The Mozambique Population Health Implementation and Training (PHIT) Partnership focuses on improving the quality of routine data and its use through appropriate tools to facilitate decision making by health system managers; strengthening management and planning capacity and funding district health plans; and building capacity for operations research to guide system-strengthening efforts. This seven-year effort covers all 13 districts and 146 health facilities in Sofala Province.

Evaluation design

A quasi-experimental controlled time-series design will be used to assess the overall impact of the partnership strategy on under-5 mortality by examining changes in mortality pre- and post-implementation in Sofala Province compared with neighboring Manica Province. The evaluation will compare a broad range of input, process, output, and outcome variables to strengthen the plausibility that the partnership strategy led to health system improvements and subsequent population health impact.

Discussion

The Mozambique PHIT Partnership expects to provide evidence on the effect of efforts to improve data quality coupled with the introduction of tools, training, and supervision to improve evidence-based decision making. This contribution to the knowledge base on what works to enhance health systems is highly replicable for rapid scale-up to other provinces in Mozambique, as well as other sub-Saharan African countries with limited resources and a commitment to comprehensive primary health care.

Economic evaluation of Australian acute care accreditation (ACCREDIT-CBA (Acute)): study protocol for a mixed-method research project

INTRODUCTION

The Accreditation Collaborative for the Conduct of Research, Evaluation and Designated Investigations through Teamwork-Cost-Benefit Analysis (ACCREDIT-CBA (Acute)) study is designed to determine and make explicit the costs and benefits of Australian acute care accreditation and to determine the effectiveness of acute care accreditation in improving patient safety and quality of care. The cost-benefit analysis framework will be provided in the form of an interactive model for industry partners, health regulators and policy makers, accreditation agencies and acute care service providers.

METHODS AND DESIGN

The study will use a mixed-method approach to identify, quantify and monetise the costs and benefits of accreditation. Surveys, expert panels, focus groups, interviews and primary and secondary data analysis will be used in cross-sectional and case study designs.

ETHICS AND DISSEMINATION

The University of New South Wales Human Research Ethics Committee has approved this project (approval number HREC 10274). The results of the study will be reported via peer-reviewed publications, conferences and seminar resentations and will form part of a doctoral thesis.