Do European hospitals have quality and safety governance systems and structures in place?

Qualitative exploration of the Medical Examiner role in identifying problems with the quality of patient care

OBJECTIVE

A national system of Medical Examiners (MEs) implemented in England and Wales from April 2019 was intended to ensure that every death receives scrutiny from an independent, senior doctor, resulting in early detection of problems in care. The aim of this study was to increase understanding of how the ME role operates to identify problems related to quality of patient care and to explore the potential for development to maximise learning opportunities.

DESIGN

A qualitative approach involved the use of semi-structured interviews. Data analysis employed a framework approach.

SETTING

Study participants were recruited from 11 acute hospitals in England, known to be operating an ME service.

PARTICIPANTS

A purposive sample of 20 MEs and one ME officer.

RESULTS

MEs brought different perspectives to the role based on their medical background. The process for identifying and acting on quality of care concerns was broadly consistent, with a notable consensus regarding the value of speaking to bereaved relatives. Variation was identified within and between services in relation to how core components are carried out and the perceived salience of information, which appeared to reflect individual and service preferences as well as different organisational pathways. ME services required flexibility to accommodate fluctuating demand, but funding arrangements imposed restrictions. The majority of MEs highlighted limited opportunity for formal team contact and a lack of meaningful feedback as limiting scope for development.

CONCLUSION

Core components of the ME role were being conducted, although individual and systemic variations in practice were identified. The discussion with bereaved relatives is a unique feature of the ME role and was considered highly valuable, both for the organisation and relatives. Further development could consider the impact of the variation identified and address mechanisms for feedback and shared learning.

Challenges facing healthcare leadership in attaining accreditation of teaching hospitals

PURPOSE

This paper aims to examine the challenges faced by health-care leadership in teaching hospitals in attaining accreditation for their institutions.

DESIGN/METHODOLOGY/APPROACH

This paper is based on a study of current literature on health-care leadership, hospital accreditation and quality of patient care and identifies the challenges facing health-care leadership in attaining accreditation for teaching hospitals.

FINDINGS

Based on a review and analysis of literature, infrastructure, finance, legal support, workforce recruitment and training, documentation and technology are identified as challenges faced by health-care leadership in teaching hospitals. The key challenges facing health-care leadership with respect to medical education and clinical research are found to be integration of education into hospital operations, compliance with all regulatory and professional requirements and adequacy of resources in executing research programs.

ORIGINALITY/VALUE

This study draws the attention of health-care leadership in teaching hospitals on the challenges they face in obtaining accreditation for their institutions so that they may develop appropriate strategies to overcome them.

Important factors for effective patient safety governance auditing: a questionnaire survey

Background

Audits are increasingly used for patient safety governance purposes. However, there is little insight into the factors that hinder or stimulate effective governance based on auditing. The aim of this study is to quantify the factors that influence effective auditing for hospital boards and executives.

Methods

A questionnaire of 32 factors was developed using influencing factors found in a qualitative study on effective auditing. Factors were divided into four categories. The questionnaire was sent to the board of directors, chief of medical staff, nursing officer, medical department head and director of the quality and safety department of 89 acute care hospitals in the Netherlands.

Results

We approached 522 people, of whom 211 responded. Of the 32 factors in the questionnaire, 30 factors had an agreement percentage higher than 50%. Important factors per category were ‘audit as an improvement tool as well as a control tool’, ‘department is aware of audit purpose’, ‘quality of auditors’ and ‘learning culture at department’. We found 14 factors with a significant difference in agreement between stakeholders of at least 20%. Amongst these were ‘medical specialist on the audit team’, ‘soft signals in the audit report’, ‘patients as auditors’ and ‘post-audit support’.

Conclusion

We found 30 factors for effective auditing, which we synthesised into eight recommendations to optimise audits. Hospitals can use these recommendations as a framework for audits that enable boards to become more in control of patient safety in their hospital.

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3577-9) contains supplementary material, which is available to authorized users.

Evaluation of the organisation and effectiveness of internal audits to govern patient safety in hospitals: a mixed-methods study

OBJECTIVES

Hospital boards are legally responsible for safe healthcare. They need tools to assist them in their task of governing patient safety. Almost every Dutch hospital performs internal audits, but the effectiveness of these audits for hospital governance has never been evaluated. The aim of this study is to evaluate the organisation of internal audits and their effectiveness for hospitals boards to govern patient safety.

DESIGN AND SETTING

A mixed-methods study consisting of a questionnaire regarding the organisation of internal audits among all Dutch hospitals (n=89) and interviews with stakeholders regarding the audit process and experienced effectiveness of audits within six hospitals.

RESULTS

Response rate of the questionnaire was 76% and 43 interviews were held. In every responding hospital, the internal audits followed the plan-do-check-act cycle. Every hospital used interviews, document analysis and site visits as input for the internal audit. Boards stated that effective aspects of internal audits were their multidisciplinary scope, their structured and in-depth approach, the usability to monitor improvement activities and to change hospital policy and the fact that results were used in meetings with staff and boards of supervisors. The qualitative methods (interviews and site visits) used in internal audits enable the identification of soft signals such as unsafe culture or communication and collaboration problems. Reported disadvantages were the low frequency of internal audits and the absence of soft signals in the actual audit reports.

CONCLUSION

This study shows that internal audits are regarded as effective for patient safety governance, as they help boards to identify patient safety problems, proactively steer patient safety and inform boards of supervisors on the status of patient safety. The description of the Dutch internal audits makes these audits replicable to other healthcare organisations in different settings, enabling hospital boards to complement their systems to govern patient safety.

Deepening our Understanding of Quality in Australia (DUQuA): a study protocol for a nationwide, multilevel analysis of relationships between hospital quality management systems and patient factors

INTRODUCTION

Despite the growing body of research on quality and safety in healthcare, there is little evidence of the association between the way hospitals are organised for quality and patient factors, limiting our understanding of how to effect large-scale change. The 'Deepening our Understanding of Quality in Australia' (DUQuA) study aims to measure and examine relationships between (1) organisation and department-level quality management systems (QMS), clinician leadership and culture, and (2) clinical treatment processes, clinical outcomes and patient-reported perceptions of care within Australian hospitals.

METHODS AND ANALYSIS

The DUQuA project is a national, multilevel, cross-sectional study with data collection at organisation (hospital), department, professional and patient levels. Sample size calculations indicate a minimum of 43 hospitals are required to adequately power the study. To allow for rejection and attrition, 70 hospitals across all Australian jurisdictions that meet the inclusion criteria will be invited to participate. Participants will consist of hospital quality management professionals; clinicians; and patients with stroke, acute myocardial infarction and hip fracture. Organisation and department-level QMS, clinician leadership and culture, patient perceptions of safety, clinical treatment processes, and patient outcomes will be assessed using validated, evidence-based or consensus-based measurement tools. Data analysis will consist of simple correlations, linear and logistic regression and multilevel modelling. Multilevel modelling methods will enable identification of the amount of variation in outcomes attributed to the hospital and department levels, and the factors contributing to this variation.

ETHICS AND DISSEMINATION

Ethical approval has been obtained. Results will be disseminated to individual hospitals in de-identified national and international benchmarking reports with data-driven recommendations. This ground-breaking national study has the potential to influence decision-making on the implementation of quality and safety systems and processes in Australian and international hospitals.

Governance standards: A roadmap for increasing safety at care transitions

Reducing the rate of adverse events and preventable harm associated with healthcare delivery is a policy priority across healthcare systems internationally. Care transitions or handovers in clinical care introduce risk to patients that can lead to adverse events. Building on the literature showing the impact of governing boards on the quality and safety of healthcare services, this study builds a predictive model between governance and safety at care transitions. Analysis was based on 490 Canadian healthcare organizations across six sectors of care. Organizational compliance with the Accreditation Canada Governance Standards was shown to be a predictor of organizational performance with the Medication Reconciliation Required Organizational Practice. Results indicate that among a comprehensive set of governance standards, a set of 11 central governance elements predict organizational medication reconciliation practice. Implications for healthcare leaders are discussed including the role of organizational leadership in medication reconciliation practices. The importance of a governance process cycle that encompasses board prioritization of desired goals, monitoring of performance regularly, and communicating results with stakeholders is shown.

Deepening our understanding of quality improvement in Europe (DUQuE): overview of a study of hospital quality management in seven countries

Introduction and Objective

This paper provides an overview of the DUQuE (Deepening our Understanding of Quality Improvement in Europe) project, the first study across multiple countries of the European Union (EU) to assess relationships between quality management and patient outcomes at EU level. The paper describes the conceptual framework and methods applied, highlighting the novel features of this study.

Design

DUQuE was designed as a multi-level cross-sectional study with data collection at hospital, pathway, professional and patient level in eight countries.

Setting and Participants

We aimed to collect data for the assessment of hospital-wide constructs from up to 30 randomly selected hospitals in each country, and additional data at pathway and patient level in 12 of these 30.

Main outcome measures

A comprehensive conceptual framework was developed to account for the multiple levels that influence hospital performance and patient outcomes. We assessed hospital-specific constructs (organizational culture and professional involvement), clinical pathway constructs (the organization of care processes for acute myocardial infarction, stroke, hip fracture and deliveries), patient-specific processes and outcomes (clinical effectiveness, patient safety and patient experience) and external constructs that could modify hospital quality (external assessment and perceived external pressure).

Results

Data was gathered from 188 hospitals in 7 participating countries. The overall participation and response rate were between 75% and 100% for the assessed measures.

Conclusions

This is the first study assessing relation between quality management and patient outcomes at EU level. The study involved a large number of respondents and achieved high response rates. This work will serve to develop guidance in how to assess quality management and makes recommendations on the best ways to improve quality in healthcare for hospital stakeholders, payers, researchers, and policy makers throughout the EU.

Understanding and benchmarking health service achievement of policy goals for chronic disease

BACKGROUND

Key challenges in benchmarking health service achievement of policy goals in areas such as chronic disease are: 1) developing indicators and understanding how policy goals might work as indicators of service performance; 2) developing methods for economically collecting and reporting stakeholder perceptions; 3) combining and sharing data about the performance of organizations; 4) interpreting outcome measures; 5) obtaining actionable benchmarking information. This study aimed to explore how a new Boolean-based small-N method from the social sciences-Qualitative Comparative Analysis or QCA-could contribute to meeting these internationally shared challenges.

METHODS

A 'multi-value QCA' (MVQCA) analysis was conducted of data from 24 senior staff at 17 randomly selected services for chronic disease, who provided perceptions of 1) whether government health services were improving their achievement of a set of statewide policy goals for chronic disease and 2) the efficacy of state health office actions in influencing this improvement. The analysis produced summaries of configurations of perceived service improvements.

RESULTS

Most respondents observed improvements in most areas but uniformly good improvements across services were not perceived as happening (regardless of whether respondents identified a state health office contribution to that improvement). The sentinel policy goal of using evidence to develop service practice was not achieved at all in four services and appears to be reliant on other kinds of service improvements happening.

CONCLUSIONS

The QCA method suggested theoretically plausible findings and an approach that with further development could help meet the five benchmarking challenges. In particular, it suggests that achievement of one policy goal may be reliant on achievement of another goal in complex ways that the literature has not yet fully accommodated but which could help prioritize policy goals. The weaknesses of QCA can be found wherever traditional big-N statistical methods are needed and possible, and in its more complex and therefore difficult to empirically validate findings. It should be considered a potentially valuable adjunct method for benchmarking complex health policy goals such as those for chronic disease.

Variation in the adoption of patient safety practices among New Zealand district health boards

OBJECTIVE

To investigate the adoption and impact of quality improvement measures in New Zealand hospitals.

METHOD

Structured interviews with quality and safety managers of District Health Boards (DHBs). Correlation of use of measures with adjusted 30-day mortality data.

RESULTS

Eighteen of New Zealand's 21 DHBs participated in the survey. Structural or policy measures to improve patient safety, such as credentialing and event reporting procedures, had been introduced into all DHBs, whereas changes to general clinical processes such as medicine reconciliation, falls prevention interventions and disease-specific management guidelines were less consistently used. There was no meaningful correlation between risk-adjusted mortality rates for three common medical conditions and related quality measures.

CONCLUSION

Widespread variation exists among New Zealand DHBs in their adoption of quality and safety practices, especially in relation to clinical processes of care.

Factors associated with the implementation of quality and safety requirements for cross-border care in acute myocardial infarction: Results from 315 hospitals in four countries

OBJECTIVE

Cross-border patients have specific quality and safety requirements for hospital care. Little is known to what extent hospitals meet these requirements. We aim to assess their current level, and the factors associated with their implementation.

METHODS

A cross-sectional survey of 315 hospitals and cardiology departments in the Czech Republic, France, Poland and Spain. Employing bi-variate statistics and logistic regression analysis, we assess quality and safety requirements for cross-border patients and their association with hospital characteristics, cross-border care arrangements, proximity to EU borders, the hospital's quality improvement system, and country.

RESULTS

Certain quality and safety requirements are frequently met (administrative support or informed consent using forms in various EU languages) while others are widely absent (case-managers, contacts to patients' general practitioners). Due to communication problems, it is often not possible to inform patients about their condition and treatment. Discharge summaries are rarely available in other than the vernacular languages, and medication upon discharge and arranging back-transfer occur occasionally only. Logistic regression analysis suggests a strong effect of country-level covariates (followed by type of hospital, hospital size and hospital's quality improvement system), but covariates are not consistently associated with higher rates of implementation. Hospitals with existing cross-border care collaboration do not differ substantially from hospitals without such arrangements.

CONCLUSION

Cross-border patients have specific quality and safety requirements that are not always met. Various factors are associated with these requirements; however, the trend is not systematic and the underlying mechanisms need to be studied further to inform policy decisions.

Accreditation and ISO certification: do they explain differences in quality management in European hospitals?

BACKGROUND

Hospital accreditation and International Standardisation Organisation (ISO) certification offer alternative mechanisms for improving safety and quality, or as a mark of achievement. There is little published evidence on their relative merits.

OBJECTIVE

To identify systematic differences in quality management between hospitals that were accredited, or certificated, or neither. Research design

ANALYSIS

of compliance with measures of quality in 89 hospitals in six countries, as assessed by external auditors using a standardized tool, as part of the EC-funded

METHODS

of Assessing Response to Quality Improvement Strategies project.

MAIN OUTCOME MEASURES

Compliance scores in six dimensions of each hospital-grouped according to the achievement of accreditation, certification or neither.

RESULTS

Of the 89 hospitals selected for external audit, 34 were accredited (without ISO certification), 10 were certificated under ISO 9001 (without accreditation) and 27 had neither accreditation nor certification. Overall percentage scores for 229 criteria of quality and safety were 66.9, 60.0 and 51.2, respectively. Analysis confirmed statistically significant differences comparing mean scores by the type of external assessment (accreditation, certification or neither); however, it did not substantially differentiate between accreditation and certification only. Some of these associations with external assessments were confounded by the country in which the sample hospitals were located.

CONCLUSIONS

It appears that quality and safety structures and procedures are more evident in hospitals with either the type of external assessment and suggest that some differences exist between accredited versus certified hospitals. Interpretation of these results, however, is limited by the sample size and confounded by variations in the application of accreditation and certification within and between countries.

Investigating organizational quality improvement systems, patient empowerment, organizational culture, professional involvement and the quality of care in European hospitals: the 'Deepening our Understanding of Quality Improvement in Europe (DUQuE)' project

Background

Hospitals in European countries apply a wide range of quality improvement strategies. Knowledge of the effectiveness of these strategies, implemented as part of an overall hospital quality improvement system, is limited.

Methods/Design

We propose to study the relationships among organisational quality improvement systems, patient empowerment, organisational culture, professionals' involvement with the quality of hospital care, including clinical effectiveness, patient safety and patient involvement. We will employ a cross-sectional, multi-level study design in which patient-level measurements are nested in hospital departments, which are in turn nested in hospitals in different EU countries. Mixed methods will be used for data collection, measurement and analysis. Hospital/care pathway level constructs that will be assessed include external pressure, hospital governance, quality improvement system, patient empowerment in quality improvement, organisational culture and professional involvement. These constructs will be assessed using questionnaires. Patient-level constructs include clinical effectiveness, patient safety and patient involvement, and will be assessed using audit of patient records, routine data and patient surveys. For the assessment of hospital and pathway level constructs we will collect data from randomly selected hospitals in eight countries. For a sample of hospitals in each country we will carry out additional data collection at patient-level related to four conditions (stroke, acute myocardial infarction, hip fracture and delivery). In addition, structural components of quality improvement systems will be assessed using visits by experienced external assessors. Data analysis will include descriptive statistics and graphical representations and methods for data reduction, classification techniques and psychometric analysis, before moving to bi-variate and multivariate analysis. The latter will be conducted at hospital and multilevel. In addition, we will apply sophisticated methodological elements such as the use of causal diagrams, outcome modelling, double robust estimation and detailed sensitivity analysis or multiple bias analyses to assess the impact of the various sources of bias.

Discussion

Products of the project will include a catalogue of instruments and tools that can be used to build departmental or hospital quality and safety programme and an appraisal scheme to assess the maturity of the quality improvement system for use by hospitals and by purchasers to contract hospitals.

Impact of quality strategies on hospital outputs

CONTEXT

This study was part of the Methods of Assessing Response to Quality Improvement Strategies (MARQuIS) research project on patients crossing borders, a study to investigate quality improvement strategies in healthcare systems across the European Union (EU).

AIM

To explore the association between the implementation of quality improvement strategies in hospitals and hospitals' success in meeting defined quality requirements that are considered intermediate outputs of the care process.

METHODS

Data regarding the implementation of seven quality improvement strategies (accreditation, organisational quality management programmes, audit and internal assessment of clinical standards, patient safety systems, clinical practice guidelines, performance indicators and systems for obtaining patients' views) and four dimensions of outputs (clinical, safety, patient-centredness and cross-border patient-centredness) were collected from 389 acute care hospitals in eight EU countries using a web-based questionnaire. In a second phase, 89 of these hospitals participated in an on-site audit by independent surveyors. Pearson correlation and linear regression models were used to explore associations and relations between quality improvement strategies and achievement of outputs.

RESULTS

Positive associations were found between six internal quality improvement strategies and hospital outputs. The quality improvement strategies could be reasonably subsumed under one latent index which explained about half of their variation. The analysis of outputs concluded that the outputs can also be considered part of a single construct. The findings indicate that the implementation of internal as well as external quality improvement strategies in hospitals has beneficial effects on the hospital outputs studied here.

CONCLUSION

The implementation of internal quality improvement strategies as well as external assessment systems should be promoted.

Cross-border care and healthcare quality improvement in Europe: the MARQuIS research project

Citizens are increasingly crossing borders within the European Union (EU). Europeans have always been free to travel to receive care abroad, but if they wished to benefit from their statutory social protection scheme, they were subject to their local or national legislation on social protection. This changed in 1991 with the European Court of Justice defining healthcare as a service, starting a debate on the right balance between different principles in European treaties: movement of persons, goods and services, versus the responsibility of member states to organise their healthcare systems. Simultaneously, cross-border cooperation has developed between member states.

In this context, patient mobility has become a relevant issue on the EU’s agenda. The EU funded a number of Scientific Support to Policies (SSP) activities within the Sixth Framework Programme, to provide the evidence needed by EU policy makers to deal with issues that European citizens face due to enhanced mobility in Europe. One SSP project “Methods of Assessing Response to Quality Improvement Strategies” (MARQuIS), focused on cross-border care. It aimed to assess the value of different quality strategies, and to provide information needed when: (1) countries contract care for patients moving across borders; and (2) individual hospitals review the design of their quality strategies. This article describes the European context related to healthcare, and its implications for cross-border healthcare in Europe. The background information demonstrates a need for further research and development in this area.

Implementation of patient safety strategies in European hospitals

CONTEXT

This study is part of the Methods of Assessing Response to Quality Improvement Strategies (MARQuIS) research project on cross-border care, investigating quality improvement strategies in healthcare systems across the European Union (EU).

AIM

To explore to what extent a sample of acute care European hospitals have implemented patient safety strategies and mechanisms and whether the implementation is related to the type of hospital.

METHODS

Data were collected on patient safety structures and mechanisms in 389 acute care hospitals in eight EU countries using a web-based questionnaire. Subsequently, an on-site audit was carried out by independent surveyors in 89 of these hospitals to assess patient safety outputs. This paper presents univariate and bivariate statistics on the implementation and explores the associations between implementation of patient safety strategies and hospital type using the chi(2) test and Fisher exact test.

RESULTS

Structures and plans for safety (including responsibilities regarding patient safety management) are well developed in most of the hospitals that participated in this study. The study found greater variation regarding the implementation of mechanisms or activities to promote patient safety, such as electronic drug prescription systems, guidelines for prevention of wrong patient, wrong site and wrong surgical procedure, and adverse events reporting systems. In the sample of hospitals that underwent audit, a considerable proportion do not comply with basic patient safety strategies--for example, using bracelets for adult patient identification and correct labelling of medication.

Learning from MARQuIS: future direction of quality and safety in hospital care in the European Union

This article summarises the significant lessons to be drawn from, and the policy implications of, the findings of the Methods of Assessing Response to Quality Improvement Strategies (MARQuIS) project--a part of the suite of research projects intended to support policy established by the European Commission through its Sixth Framework Programme. The article first reviews the findings of MARQuIS and their implications for healthcare providers (and particularly for hospitals), and then addresses the broader policy implications for member states of the European Union (EU) and for the commission itself. Against the background of the European Commission's Seventh Framework Programme, it then outlines a number of future areas for research to inform policy and practice in quality and safety in Europe. The article concludes that at this stage, a unique EU-wide quality improvement system for hospitals does not seem to be feasible or effective. Because of possible future community action in this field, attention should focus on the use of existing research on quality and safety strategies in healthcare, with the aim of combining soft measures to accelerate mutual learning. Concrete measures should be considered only in areas for which there is substantial evidence and effective implementation can be ensured.

Application of quality improvement strategies in 389 European hospitals: results of the MARQuIS project

CONTEXT

This study was part of the Methods of Assessing Response to Quality Improvement Strategies (MARQuIS) research project investigating the impact of quality improvement strategies on hospital care in various countries of the European Union (EU), in relation to specific needs of cross-border patients.

AIM

This paper describes how EU hospitals have applied seven quality improvement strategies previously defined by the MARQuIS study: organisational quality management programmes; systems for obtaining patients' views; patient safety systems; audit and internal assessment of clinical standards; clinical and practice guidelines; performance indicators; and external assessment.

METHODS

A web-based questionnaire was used to survey acute care hospitals in eight EU countries. The reported findings were later validated via on-site survey and site visits in a sample of the participating hospitals. Data collection took place from April to August 2006.

RESULTS

389 hospitals participated in the survey; response rates varied per country. All seven quality improvement strategies were widely used in European countries. Activities related to external assessment were the most broadly applied across Europe, and activities related to patient involvement were the least widely implemented. No one country implemented all quality strategies at all hospitals. There were no differences between participating hospitals in western and eastern European countries regarding the application of quality improvement strategies.

CONCLUSIONS

Implementation varied per country and per quality improvement strategy, leaving considerable scope for progress in quality improvements. The results may contribute to benchmarking activities in European countries, and point to further areas of research to explore the relationship between the application of quality improvement strategies and actual hospital performance.