Managing to improve quality: The relationship between accreditation standards, safety practices, and patient outcomes

Assessing the Presence of the Joint Commission International Accreditation Requirements in Western Saudi Arabia Hospital Pharmacies: A Cross-sectional Study

Objective

The Central Board of Accreditation for Healthcare Institutions (CBAHI) the national Saudi accreditation body accredited most hospitals in Saudi Arabia whereas, the Joint Commission International (JCI) a well-known international accreditation body accredited some hospitals. We assessed Western Saudi Arabia hospital pharmacists' knowledge, opinions, and observations about pharmacy-related JCI accreditation criteria needed for hospitals.

Methods

This was a cross-sectional survey-based study conducted among pharmacy personnel working in the Ministry of Health (MOH), Military, and private hospitals in the Makkah region in western Saudi Arabia. The present report represents the findings of descriptive and comparative analyses. Comparative analyses were tested by Student's t-test, analysis of variance, and Chi-square when applicable and a P ≤ 0.05 was considered statistically significant.

Findings

One hundred and one pharmacists completed the survey; most of them were from Taif (53.5%) and Jeddah (37.6%) and fewer from Makkah (8.9%). The highest proportions were from MOH (55.4%), private (29.7%), and some from military (14.9%) hospitals. They worked mostly in hospitals accredited with CBAHI (93.1%) than JCI (58.4%) and only (41.6%) worked with quality units. Correct answers on knowledge items ranged from 14.9% to 65.3%. On five-point Likert Scale, they showed supportive ratings on how they perceived the importance of JCI statement provided (overall average score: 3.78) and on how statement criteria are implemented in their hospitals (overall average score: 3.76). Higher proportions of those working in quality units compared to their counterparts were aware that accreditation cycles for JCI and CBAHI are identical (66.7% vs. 55.9%, P = 0.009) and that JCI criteria are more concise than CBAHI (59.5% vs. 52.5%, P = 0.007). Higher proportions of those working in JCI-accredited hospitals compared to their counterparts were aware that JCI criteria are clearer than CBAHI (55.9% vs. 33.3%, P = 0.021) and that JCI criteria are more concise than CBAHI (61% vs. 47.6%, P = 0.012).

Conclusion

To a high extent, pharmacists were supportive of JCI criteria and considered the criteria to be implemented in their hospitals. There is a room for improvement to enhance awareness and support of JCI quality criteria among pharmacists.

Association Between Hospital Accreditation and Outcomes: The Analysis of Inhospital Mortality From the National Claims Data of the Universal Coverage Scheme in Thailand

BACKGROUND

In Thailand, hospital accreditation (HA) is widely recognized as one of the system tools to promote effective operation of universal health coverage. This nationwide study aims to examine the relationship between accredited statuses of the provincial hospitals and their mortality outcomes.

METHOD

A 5-year retrospective analysis of the Universal Coverage Scheme's claim dataset was conducted, using 1 297 869 inpatient discharges from 76 provincial hospital networks under the Ministry of Public Health. Mortality outcomes of 3 major acute care conditions, including acute myocardial infarction, acute stroke, and sepsis, were selected.

RESULTS

Using generalized estimating equations to adjust for area-based control variables, hospital networks with HA-accredited provincial hospitals showed significant associations with lower standardized mortality ratios of acute stroke and sepsis.

CONCLUSION

Our findings added supportive evidence that HA, as an organizational and health system management tool, could help promote hospital quality and safety in a developing country, leading to better outcomes.

Operations-oriented strategies and patient satisfaction: the mediating effect of service experience

Purpose

The purpose of this study is to explore the direct and indirect effects of perceived provider professionalism and service recovery in enhancing patient satisfaction in a developing country.

Design/methodology/approach

This study used a survey method to investigate satisfaction among health-care consumers. This study used data collected from 210 health-care consumers to empirically test the hypotheses via structural equation modeling

Findings

This study found that service recovery has a significant direct effect on patient satisfaction. Though this study did not find perceived provider professionalism to have a direct effect on patient satisfaction, it found an indirect effect in the relationship via service experience. Thus, service experience fully/completely mediates the relationship between perceived provider professionalism and patient satisfaction, while partially mediating the significant relationship between service recovery and patient satisfaction.

Originality/value

The results further underscore the need for health-care organizations in developing countries to focus on mindfully developing operations-oriented strategies that lead to the delivery of memorable service experiences for patients.

Understanding how and why audits work in improving the quality of hospital care: A systematic realist review

BACKGROUND

Several types of audits have been used to promote quality improvement (QI) in hospital care. However, in-depth studies into the mechanisms responsible for the effectiveness of audits in a given context is scarce. We sought to understand the mechanisms and contextual factors that determine why audits might, or might not, lead to improved quality of hospital care.

METHODS

A realist review was conducted to systematically search and synthesise the literature on audits. Data from individual papers were synthesised by coding, iteratively testing and supplementing initial programme theories, and refining these theories into a set of context-mechanism-outcome configurations (CMOcs).

RESULTS

From our synthesis of 85 papers, seven CMOcs were identified that explain how audits work: (1) externally initiated audits create QI awareness although their impact on improvement diminishes over time; (2) a sense of urgency felt by healthcare professionals triggers engagement with an audit; (3) champions are vital for an audit to be perceived by healthcare professionals as worth the effort; (4) bottom-up initiated audits are more likely to bring about sustained change; (5) knowledge-sharing within externally mandated audits triggers participation by healthcare professionals; (6) audit data support healthcare professionals in raising issues in their dialogues with those in leadership positions; and (7) audits legitimise the provision of feedback to colleagues, which flattens the perceived hierarchy and encourages constructive collaboration.

CONCLUSIONS

This realist review has identified seven CMOcs that should be taken into account when seeking to optimise the design and usage of audits. These CMOcs can provide policy makers and practice leaders with an adequate conceptual grounding to design contextually sensitive audits in diverse settings and advance the audit research agenda for various contexts.

PROSPERO REGISTRATION

CRD42016039882.

Iran hospital accreditation standards: challenges and solutions

OBJECTIVE

The purpose of this study was to identify the challenges of Iranian hospital accreditation standards and provide solutions.

DESIGN

A qualitative research design was used in this study. Open and semi-structured interviews were conducted in 2018. Thematic analysis was used to analyse qualitative data.

SETTING

Public, private, semi-public, charity and military hospitals in Tehran, Iran.

PARTICIPANTS

A pluralistic evaluation approach was employed and 151 participants including policy makers, hospital management and staff, accreditation surveyors and university professors participated in this study.

RESULTS

Challenges of hospital accreditation standards were grouped into two groups: standards development process and standards content. Lack of an independent standards development committee, insufficient expertise of committee members, inconsistencies among the standards' constructs, inappropriate standard classification, ambiguity of standards, unmeasurable standards, vague and inflexible scoring system, and inability to use some standards were the main challenges of Iran hospital accreditation standards. Establishing a scientific committee consisting of representative from hospitals, health insurance companies, professional and scientific associations and universities for standard development, training the committee members, and utilizing hospital's feedback will help address these problems.

CONCLUSION

Iran's hospital accreditation standards face challenges that prevent them from achieving their goals, that is, improving the quality, safety, effectiveness and efficiency of hospital services. Necessary measures should be taken to solve these problems.

The Impact of a National Accreditation Program on Patient Safety Culture in a Tertiary Hospital: Pre- and Post-Evaluation Study

Introduction

The objective of this study was to assess the effectiveness of the Saudi national accreditation program on patient safety culture in a secondary-tertiary public hospital in Saudi Arabia.

Methods

Three hundred health professionals were randomly selected to participate in a survey. The survey was used in three phases: baseline, before accreditation, and after accreditation. Primary and secondary outcome measures were teamwork within hospital units, feedback and communication about errors, hospital handoffs and transitions, overall perceptions of safety, frequency of event reporting, and perception of patient safety grade.

Results

The survey response rate was 100%. A statistically significant impact of accreditation was found for teamwork within hospital units, feedback and communication about errors, and hospital handoffs and transitions (p = 0.002, 0.009, and 0.010, respectively). Ordinal logistic regression confirmed that the accreditation program had a significant effect on overall perceptions of safety (odds ratio [OR] [1.42-13.56], p = 0.010), frequency of event reporting (OR [0.91-7.96], p = 0.073), and staff awareness of grading safety culture (OR [0.02-0.70]) and reporting behavior (OR 0.10 [0.03-0.37]).

Conclusion

The Saudi national accreditation program had a significant positive impact on some patient safety culture dimensions and outcomes. These findings provide local empirical evidence on the benefits of implementing national accreditation programs. Further research on a larger scale is highly recommended.

Testing the Strength of Hospital Accreditation as a Signal of the Quality of Care in Romania: Do Patients' and Health Professionals' Perceptions Align?

Hospital accreditation, as a quality signal, is gaining its popularity among low- and middle-income countries, such as Romania, despite its costly nature. Nevertheless, its effectiveness as a quality signal in driving patients' choice of hospital services remains unclear. In this study, we intend to empirically explore the perceptions of both healthcare professionals and patients toward Romanian hospital accreditation and identify perception gaps between the two parties. Exploratory and confirmatory factor analyses were carried out to extract the latent constructs of health professionals' perceived effects of hospital accreditation. The Wilcoxon rank-sum test and Kruskal-Wallis test were used to identify correlations between patients' sociodemographic characteristics and their behavioral intentions when confronted with low-quality services. We found that health professionals believe that hospital accreditation plays a positive role in improving patient satisfaction, institutional reputation, and healthcare services quality. However, we found a lack of awareness of hospital accreditation status among patients, indicating the existence of the perception gap of the accreditation effectiveness as a market signal. Our results suggest that the effect of interpersonal trust in current service providers may distract patients from the accreditation status. Our study provides important practical implications for Romanian hospitals on enhancing the quality of accreditation signal and suggests practical interventions.

S. Impact of accreditation on performance of healthcare organizations

Purpose

The purpose of this paper is to review the accreditation research in specific to its effect on the performance of healthcare organizations.

Design/methodology/approach

A comprehensive search and analysis of literature on the effect of healthcare accreditation were conducted between June 2017 and May 2018. The study identified 62 empirical research studies that examined the effect of healthcare accreditation programmes. Study particulars such as year of publication, objectives, focus of the study, research settings and key findings were recorded. A content analysis was performed to identify the frequency of the main themes in the literature. Knowledge gaps needing further examination were identified.

Findings

Majority of the accreditation impact studies were carried out in the developed nations (n = 49). The thematic categories, that is the impact on “patient safety and healthcare quality” (n = 26), “healthcare professionals’ views” (n = 28) and “clinical process and outcomes” (n = 17) were addressed more times. Whereas the other two thematic categories “organizational performance” and “consumers’ views or satisfaction,” each was examined less than 10 instances. This review reveals mixed views on effect of healthcare accreditation. The varied quality of studies and the availability of a few studies on consumers’ perception of accreditation effectiveness were the important limiting factors of this review.

Originality/value

The findings are valuable to healthcare managers and hospital administrators in accreditation decisions, whereas findings are of value to researchers and academicians in terms of gaps identified for future research studies pertaining to the impact of healthcare accreditation. Future studies need to consider holistic theoretical frameworks for assessing the effect of accreditation on performance of healthcare organizations to achieve precise results.

The effect of external inspections on safety in acute hospitals in the National Health Service in England: A controlled interrupted time-series analysis

Objectives

To evaluate the effect of Care Quality Commission external inspections of acute trusts on adverse event rates in the English National Health Service.

Methods

Interrupted time-series analysis including all acute NHS trusts in England ( n = 155) using two control groups (new versus historical inspection regime and trusts not inspected). Multilevel random-coefficient modelling of (1) rates of falls with harm and (2) pressure ulcers, from April 2012 to June 2016, was undertaken using the new, resource-intensive regime of Care Quality Commission inspections as an intervention. Data used in the model included dates and type of inspection, patient safety indicators, demographic characteristics and financial risk of hospitals.

Results

In one year, Care Quality Commission inspected 66 acute trusts (42% of all English trusts) using their new regime and 46 (30%) using their previous one. Prior to inspections being announced, rates of falls with harm and pressure ulcers were improving in both intervention and control hospitals. The announcement of an inspection did not affect either indicator. After inspections, rates of falls with harm improved more slowly, and pressure ulcer rates no longer improved for trusts inspected using both regimes.

Conclusions

Neither form of external inspection was associated with positive, clinically significant effects on adverse event rates. Any improvement happening before the announced Care Quality Commission inspections slowed after the inspection.

Accrediting private providers with National Health Insurance to better serve low-income populations in Kenya and Ghana: a qualitative study

BACKGROUND

Small private providers in low- and middle-income countries (LMICs) are well positioned to fill gaps in services to low-income populations using Social Health Insurance (SHI) schemes. However, we know little about the practical challenges both private providers and patients face in the context of SHI that may ultimately limit access to quality services for low-income populations. In this paper, we pull together data collected from private providers, patients, and SHI officials in Kenya and Ghana to answer the question: does participation in an SHI scheme affect private providers' ability to serve poorer patient populations with quality health services?

METHODS

In-depth interviews were held with 204 providers over three rounds of data collection (2013, 2015, 2017) in Kenya and Ghana. We also conducted client exit interviews in 2013 and 2017 for a total of 106 patient interviews. Ten focus group discussions (FGDs) were conducted in Kenya and Ghana respectively in 2013 for a total of 171 FGD participants. A total of 13 in-depth interviews also were conducted with officials from the Ghana National Health Insurance Agency (NHIA) and the Kenya National Hospital Insurance Fund (NHIF) across four rounds of data collection (2013, 2014, 2016, 2017). Provider interviews covered reasons for (non) enrollment in the health insurance system, experiences with the accreditation process, and benefits and challenges with the system. Client exit interviews covered provider choice, clinic experience, and SHI experience. FGDs covered the local healthcare landscape. Interviews with SHI officials covered officials' experiences working with private providers, and the opportunities and challenges they faced both accrediting providers and enrolling members. Transcripts were coded in Atlas.ti using an open coding approach and analyzed thematically.

RESULTS

Private providers and patients agreed that SHI schemes are beneficial for reducing out-of-pocket costs to patients and many providers felt they had to become SHI-accredited in order to keep their facilities open. The SHI officials in both countries corroborated these sentiments. However, due to misunderstanding of the system providers tended to charge clients for services they felt were above and beyond reimbursable expenses. Services were sometimes limited as well. Significant delays in SHI reimbursement in Ghana exacerbated these problems and compromised providers' abilities to cover basic expenses without charging patients. While patients recognized the potential benefits of SHI coverage and many sought it out, a number of patients reported allowing their enrollment to lapse for cost reasons or because they felt the coverage was useless when they were still asked to pay for services out-of-pocket at the health facility.

CONCLUSIONS

Our data point to several major barriers to SHI access and effectiveness for low-income populations in Ghana and in Kenya, in addition to opportunities to better engage private providers to serve these populations. We recommend using fee-for-service payments based on Diagnosis Related Group rather than a capitation payment system, as well as building more monitoring and accountability mechanisms into the SHI systems in order to reduce requests for informal out-of-pocket payments from patients while also ensuring quality of care. However, particularly in Ghana, these reforms should be accompanied by financial reform within the SHI system so that small private providers can be adequately funded through government financing.

Accrediting private providers with National Health Insurance to better serve low-income populations in Kenya and Ghana: a qualitative study

Background

Small private providers in low- and middle-income countries (LMICs) are well positioned to fill gaps in services to low-income populations using Social Health Insurance (SHI) schemes. However, we know little about the practical challenges both private providers and patients face in the context of SHI that may ultimately limit access to quality services for low-income populations. In this paper, we pull together data collected from private providers, patients, and SHI officials in Kenya and Ghana to answer the question: does participation in an SHI scheme affect private providers’ ability to serve poorer patient populations with quality health services?

Methods

In-depth interviews were held with 204 providers over three rounds of data collection (2013, 2015, 2017) in Kenya and Ghana. We also conducted client exit interviews in 2013 and 2017 for a total of 106 patient interviews. Ten focus group discussions (FGDs) were conducted in Kenya and Ghana respectively in 2013 for a total of 171 FGD participants. A total of 13 in-depth interviews also were conducted with officials from the Ghana National Health Insurance Agency (NHIA) and the Kenya National Hospital Insurance Fund (NHIF) across four rounds of data collection (2013, 2014, 2016, 2017). Provider interviews covered reasons for (non) enrollment in the health insurance system, experiences with the accreditation process, and benefits and challenges with the system. Client exit interviews covered provider choice, clinic experience, and SHI experience. FGDs covered the local healthcare landscape. Interviews with SHI officials covered officials’ experiences working with private providers, and the opportunities and challenges they faced both accrediting providers and enrolling members. Transcripts were coded in Atlas.ti using an open coding approach and analyzed thematically.

Results

Private providers and patients agreed that SHI schemes are beneficial for reducing out-of-pocket costs to patients and many providers felt they had to become SHI-accredited in order to keep their facilities open. The SHI officials in both countries corroborated these sentiments. However, due to misunderstanding of the system providers tended to charge clients for services they felt were above and beyond reimbursable expenses. Services were sometimes limited as well. Significant delays in SHI reimbursement in Ghana exacerbated these problems and compromised providers’ abilities to cover basic expenses without charging patients. While patients recognized the potential benefits of SHI coverage and many sought it out, a number of patients reported allowing their enrollment to lapse for cost reasons or because they felt the coverage was useless when they were still asked to pay for services out-of-pocket at the health facility.

Conclusions

Our data point to several major barriers to SHI access and effectiveness for low-income populations in Ghana and in Kenya, in addition to opportunities to better engage private providers to serve these populations. We recommend using fee-for-service payments based on Diagnosis Related Group rather than a capitation payment system, as well as building more monitoring and accountability mechanisms into the SHI systems in order to reduce requests for informal out-of-pocket payments from patients while also ensuring quality of care. However, particularly in Ghana, these reforms should be accompanied by financial reform within the SHI system so that small private providers can be adequately funded through government financing.

The impact of accreditation on healthcare quality improvement: a qualitative case study

Purpose Research on accreditation has mostly focused on assessing its impact using large scale quantitative studies, yet little is known on how quality is improved in practice through an accreditation process. Using a case study of an acute teaching hospital in Portugal, the purpose of this paper is to explore the dynamics through which accreditation can lead to an improvement in the quality of healthcare services provided. Design/methodology/approach Data for the case study was collected through 46 in-depth semi-structured interviews with 49 clinical and non-clinical members of staff. Data were analyzed using a framework thematic analysis. Findings Interviewees felt that hospital accreditation contributed to the improvement of healthcare quality in general, and more specifically to patient safety, as it fostered staff reflection, a higher standardization of practices, and a greater focus on quality improvement. However, findings also suggest that the positive impact of accreditation resulted from the approach the hospital adopted in its implementation as well as the fact that several of the procedures and practices required by accreditation were already in place at the hospital, albeit often in an informal way. Research limitations/implications The study was conducted in only one hospital. The design of an accreditation implementation plan tailored to the hospital's context can significantly contribute to positive outcomes in terms of quality and patient safety improvements. Originality/value This study provides a better understanding of how accreditation can contribute to healthcare quality improvement. It offers important lessons on the factors and processes that potentiate quality improvements through accreditation.

Improving Quality and Safety Through Use of Secondary Data: Methods Case Study

Researchers need to evaluate the strengths and weaknesses of data sets to choose a secondary data set to use for a health care study. This research method review informs the reader of the major issues necessary for investigators to consider while incorporating secondary data into their repertoire of potential research designs and shows the range of approaches the investigators may take to answer nursing research questions in a variety of context areas. The researcher requires expertise in locating and judging data sets and in the development of complex data management skills for managing large numbers of records. There are important considerations such as firm knowledge of the research question supported by the conceptual framework and the selection of appropriate databases, which guide the researcher in delineating the unit of analysis. Other more complex issues for researchers to consider when conducting secondary data research methods include data access, management and security, and complex variable construction.

Evaluating the impact of accreditation and external peer review

Purpose

– Accreditation and external peer review play important roles in assessing and improving healthcare quality worldwide. Evidence on the impact on the quality of care remains indecisive because of programme features and methodological research challenges. The purpose of this paper is to create a general methodological research framework to design future studies in this field.

Design/methodology/approach

– A literature search on effects of external peer review and accreditation was conducted using PubMed/Medline, Embase and Web of Science. Three researchers independently screened the studies. Only original research papers that studied the impact on the quality of care were included. Studies were evaluated by their objectives and outcomes, study size and analysis entity (hospitals vs patients), theoretical framework, focus of the studied programme, heterogeneity of the study population and presence of a control group.

Findings

– After careful selection 50 articles were included out of an initial 2,025 retrieved references. Analysis showed a wide variation in methodological characteristics. Most studies are performed cross-sectionally and results are not linked to the programme by a theoretical framework.

Originality/value

– Based on the methodological characteristics of previous studies the authors propose a general research framework. This framework is intended to support the design of future research to evaluate the effects of accreditation and external peer review on the quality of care.

Developing hospital accreditation standards in Uganda

BACKGROUND

Whereas accreditation is widely used as a tool to improve quality of healthcare in the developed world, it is a concept not well adapted in most developing countries for a host of reasons, including insufficient incentives, insufficient training and a shortage of human and material resources. The purpose of this paper is to describe refining use and outcomes of a self-assessment hospital accreditation tool developed for a resource-limited context.

METHODS

We invited 60 stakeholders to review a set of standards (from which a self-assessment tool was developed), and subsequently refined them to include 485 standards in 7 domains. We then invited 60 hospitals to test them. A study team traveled to each of the 40 hospitals that agreed to participate providing training and debrief the self-assessment. The study was completed in 8 weeks.

RESULTS

Hospital self-assessments revealed hospitals were remarkably open to frank rating of their performance and willing to rank all 485 measures. Good performance was measured in outreach programs, availability of some types of equipment and running water, 24-h staff calls systems, clinical guidelines and waste segregation. Poor performance was measured in care for the vulnerable, staff living quarters, physician performance reviews, patient satisfaction surveys and sterilizing equipment.

CONCLUSION

We have demonstrated the feasibility of a self-assessment approach to hospital standards in low-income country setting. This low-cost approach may be used as a good precursor to establishing a national accreditation body, as indicated by the Ministry's efforts to take the next steps. Copyright © 2015 John Wiley & Sons, Ltd.

Surveyors' perceptions of the impact of accreditation on patient safety in general practice

OBJECTIVES

To explore Australian General Practice Accreditation Limited (AGPAL) surveyors' perceptions of the impact of accreditation on patient safety and to elicit suggestions for improving patient safety in Australian general practices.

DESIGN, SETTING AND PARTICIPANTS

We conducted semi-structured telephone interviews with a purposive national sample of 10 AGPAL surveyors from 2 July to 14 December 2012. All interviews were audio recorded, transcribed and summarised.

RESULTS

All participants agreed that accreditation has improved general practices' performance in quality and safety. Participants noted specific areas that need further attention, including sufficient evidence for clinical risk management, which half the participants estimated occurs in about 5%-10% of Australian general practices. Tangible evidence of patient safety activities included having a significant incidents register, providing documentation of near misses, slips, lapses or mistakes, and engaging in regular clinical meetings to discuss incidents and how to avoid them in the future. Participants agreed that the accreditation process could be improved through the inclusion of tighter clinical safety indicators and the requirement of verifiable evidence of a working clinical risk management system.

CONCLUSIONS

Accreditation has had a positive role in improving quality and safety in general practice. The inclusion of tighter indicators that require verifiable evidence will be a step forward. The Australian Primary Care Collaboratives (APCC) Program has an opportunity to build on its previous success in general practice quality improvement to further enhance patient safety in general practice.

Health services accreditation: what is the evidence that the benefits justify the costs?

PURPOSE

To identify and analyse research on the use of economic evaluation in health services accreditation.

DATA SOURCES

Seven online health and economic databases, and key accreditation agency and health department websites were searched between June and December 2011.

STUDY SELECTION

The selection criteria were English language and published empirical research studies on the topic of economic evaluation of health service accreditation. No formal economic evaluation of health services accreditation has been carried out to date. Empirical data on costs and benefits were analysed in 6 and 15 studies, respectively. Data extraction Meta-analysis was unsuitable due to output variability. Attributes relating to

STUDY DESIGN

scalability and independence of outcome data were collected. For the benefit studies, we also assessed the strength of claim that accreditation improved patient safety and quality, and sources of potential bias.

RESULTS OF DATA SYNTHESIS

The incremental costs ranged from 0.2 to 1.7% of total costs averaged over the accreditation cycle. The benefit studies were inconclusive in terms of showing clear evidence that accreditation improves patient safety and quality of care.

CONCLUSION

The lack of formal economic appraisal makes it difficult to evaluate accreditation in comparison to other methods to improve patient safety and quality of care. The lack of a clear relationship between accreditation and the outcomes measured in the benefit studies makes it difficult to design and conduct such appraisals without a more robust and explicit understanding of the costs and benefits involved.

Narrative synthesis of health service accreditation literature

AIMS

To systematically identify and synthesise health service accreditation literature.

METHODS

A systematic identification and narrative synthesis of health service accreditation literature published prior to 2012 were conducted. The search identified 122 empirical studies that examined either the processes or impacts of accreditation programmes. Study components were recorded, including: dates of publication; research settings; levels of study evidence and quality using established rating frameworks; and key results. A content analysis was conducted to determine the frequency of key themes and subthemes examined in the literature and identify knowledge-gaps requiring research attention.

RESULTS

The majority of studies (n=67) were published since 2006, occurred in the USA (n=60) and focused on acute care (n=79). Two thematic categories, that is, 'organisational impacts' and 'relationship to quality measures', were addressed 60 or more times in the literature. 'Financial impacts', 'consumer or patient satisfaction' and 'survey and surveyor issues' were each examined fewer than 15 times. The literature is limited in terms of the level of evidence and quality of studies, but highlights potential relationships among accreditation programmes, high quality organisational processes and safe clinical care.

CONCLUSIONS

Due to the limitations of the literature, it is not prudent to make strong claims about the effectiveness of health service accreditation. Nonetheless, several critical issues and knowledge-gaps were identified that may help stimulate and inform discussion among healthcare stakeholders. Ongoing effort is required to build upon the accreditation evidence-base by using high quality experimental study designs to examine the processes, effectiveness and financial value of accreditation programmes and their critical components in different healthcare domains.

The standard of healthcare accreditation standards: a review of empirical research underpinning their development and impact

BACKGROUND

Healthcare accreditation standards are advocated as an important means of improving clinical practice and organisational performance. Standard development agencies have documented methodologies to promote open, transparent, inclusive development processes where standards are developed by members. They assert that their methodologies are effective and efficient at producing standards appropriate for the health industry. However, the evidence to support these claims requires scrutiny. The study's purpose was to examine the empirical research that grounds the development methods and application of healthcare accreditation standards.

METHODS

A multi-method strategy was employed over the period March 2010 to August 2011. Five academic health research databases (Medline, Psych INFO, Embase, Social work abstracts, and CINAHL) were interrogated, the websites of 36 agencies associated with the study topic were investigated, and a snowball search was undertaken. Search criteria included accreditation research studies, in English, addressing standards and their impact. Searching in stage 1 initially selected 9386 abstracts. In stage 2, this selection was refined against the inclusion criteria; empirical studies (n = 2111) were identified and refined to a selection of 140 papers with the exclusion of clinical or biomedical and commentary pieces. These were independently reviewed by two researchers and reduced to 13 articles that met the study criteria.

RESULTS

The 13 articles were analysed according to four categories: overall findings; standards development; implementation issues; and impact of standards. Studies have only occurred in the acute care setting, predominately in 2003 (n = 5) and 2009 (n = 4), and in the United States (n = 8). A multidisciplinary focus (n = 9) and mixed method approach (n = 11) are common characteristics. Three interventional studies were identified, with the remaining 10 studies having research designs to investigate clinical or organisational impacts. No study directly examined standards development or other issues associated with their progression. Only one study noted implementation issues, identifying several enablers and barriers. Standards were reported to improve organisational efficiency and staff circumstances. However, the impact on clinical quality was mixed, with both improvements and a lack of measurable effects recorded.

CONCLUSION

Standards are ubiquitous within healthcare and are generally considered to be an important means by which to improve clinical practice and organisational performance. However, there is a lack of robust empirical evidence examining the development, writing, implementation and impacts of healthcare accreditation standards.

A review of hospital characteristics associated with improved performance

PURPOSE

The objective of this review was to critically appraise the literature relating to associations between high-level structural and operational hospital characteristics and improved performance.

DATA SOURCES

The Cochrane Library, MEDLINE (Ovid), CINAHL, proQuest and PsychINFO were searched for articles published between January 1996 and May 2010. Reference lists of included articles were reviewed and key journals were hand searched for relevant articles.

STUDY SELECTION

and data extraction Studies were included if they were systematic reviews or meta-analyses, randomized controlled trials, controlled before and after studies or observational studies (cohort and cross-sectional) that were multicentre, comparative performance studies. Two reviewers independently extracted data, assigned grades of evidence according to the Australian National Health and Medical Research Council guidelines and critically appraised the included articles. Data synthesis Fifty-seven studies were reported within 12 systematic reviews and 47 observational articles. There was heterogeneity in use and definition of performance outcomes. Hospital characteristics investigated were environment (incentives, market characteristics), structure (network membership, ownership, teaching status, geographical setting, service size) and operational design (innovativeness, leadership, organizational culture, public reporting and patient safety practices, information technology systems and decision support, service activity and planning, workforce design, staff training and education). The strongest evidence for an association with overall performance was identified for computerized physician order entry systems. Some evidence supported the associations with workforce design, use of financial incentives, nursing leadership and hospital volume.

CONCLUSION

There is limited, mainly low-quality evidence, supporting the associations between hospital characteristics and healthcare performance. Further characteristic-specific systematic reviews are indicated.

Accreditation and ISO certification: do they explain differences in quality management in European hospitals?

BACKGROUND

Hospital accreditation and International Standardisation Organisation (ISO) certification offer alternative mechanisms for improving safety and quality, or as a mark of achievement. There is little published evidence on their relative merits.

OBJECTIVE

To identify systematic differences in quality management between hospitals that were accredited, or certificated, or neither. Research design

ANALYSIS

of compliance with measures of quality in 89 hospitals in six countries, as assessed by external auditors using a standardized tool, as part of the EC-funded

METHODS

of Assessing Response to Quality Improvement Strategies project.

MAIN OUTCOME MEASURES

Compliance scores in six dimensions of each hospital-grouped according to the achievement of accreditation, certification or neither.

RESULTS

Of the 89 hospitals selected for external audit, 34 were accredited (without ISO certification), 10 were certificated under ISO 9001 (without accreditation) and 27 had neither accreditation nor certification. Overall percentage scores for 229 criteria of quality and safety were 66.9, 60.0 and 51.2, respectively. Analysis confirmed statistically significant differences comparing mean scores by the type of external assessment (accreditation, certification or neither); however, it did not substantially differentiate between accreditation and certification only. Some of these associations with external assessments were confounded by the country in which the sample hospitals were located.

CONCLUSIONS

It appears that quality and safety structures and procedures are more evident in hospitals with either the type of external assessment and suggest that some differences exist between accredited versus certified hospitals. Interpretation of these results, however, is limited by the sample size and confounded by variations in the application of accreditation and certification within and between countries.

Incentives and barriers to implementing national hospital standards in Uganda

OBJECTIVE

The objective of this study was to elicit hospital staff's knowledge, attitudes, and current practices regarding hospital standards and to assess the level of motivation for staff and hospitals to meet new standards.

DESIGN

This was a qualitative study using in-depth interviews and focus group discussions with staff in four hospitals. There was no intervention.

SETTING

Four rural public and private not-for-profit hospitals in central Uganda.

PARTICIPANTS

Medical superintendents and other staff of four hospitals in Uganda who were familiar with the use of standards and had participated in a previous Uganda national accreditation program (Yellow Star).

RESULTS

All staff expressed strong support for the development and implementation of hospital standards, but also said they would need more recognition and ongoing motivation. They cited the need for technical assistance, funding, and training as the main obstacles. Key areas requiring standards were: infection control, cleanliness and hygiene, infrastructure and medical records.

CONCLUSIONS

There was strong support for the development and implementation of hospital standards. The main perceived obstacles to the implementation of hospital standards are resource limitations and technical capability. There is a need to develop and implement preliminary standards for hospitals in Uganda.