Selection of indicators for continuous monitoring of patient safety: recommendations of the project 'safety improvement for patients in Europe'

Aiming for patient safety indicators in radiation oncology - Results from a systematic literature review as part of the PaSaGeRO study

BACKGROUND

Patient Safety Indicators (PSIs) allow the evaluation of safety levels in healthcare settings. Despite their use in various medical fields, a specific and comprehensive PSI catalogue for radiation oncology (RO) is lacking. The Patient Safety in German Radiation Oncology (PaSaGeRO) study aims for the development of a specific PSI catalogue in radiation oncology.

OBJECTIVES

The primary objective of this systematic literature review as part of the PaSaGeRO study is to identify, formulate, and categorize PSIs specific to RO to bridge existing gaps in comprehensive patient safety evaluation.

METHODS

An electronic search in PubMed included studies from 1989 onwards, in English or German, focusing on safety and quality indicators in RO, patient safety measures, or risk analyses. Exclusions were non-transferable, country-specific measures, techniques exclusive to specific departments, and legally mandated procedures. Additional sources were identified through reference tracking and professional society websites. Two experts independently extracted PSIs from the included references.

RESULTS

Out of 157 included publications and nine secondary sources, we identified and formulated 145 PSIs. These were categorized into patient-specific processes (82, 56%), quality and risk management (42, 28%), human resources (15, 10%), and institutional culture (13, 9%).

CONCLUSION

The hereby developed PSIs provides a base for professionals to systematically evaluate and improve safety practices, addressing previously unmet needs in this field. By offering clear guidance on safety assessment, the catalogue has the potential to drive significant improvements in patient care and safety outcomes in RO. Funded by Deutsche Krebshilfe. Registered in the German Clinical Trials Register (DRKS00034690).

Improving patient safety and quality in India's largest hospital network through a dashboard driven approach - The Apollo Quality Program

Background

Quality and patient safety are the driving forces for resilient healthcare organizations. However, the healthcare leadership is central to the role of establishing the values of quality and patient safety in the organization. This task becomes extremely challenging when the safety culture has to be built across a large hospital network.

Methods

A comprehensive patient safety program, the Apollo Quality Program(AQP), structured in the form of a patient-safety dashboard was used as a tool to establish and strengthen the fabric of quality and safety across a large hospital network in India. The dashboard consisted of essential patient safety parameters that were measurable and objective. This dashboard was implemented across 41-hospitals of the network and improvement data monitored. These 41-hospitals varied in size and on basis of their bed strength they were categorized into 3 groups(A,B and C). For this study, the results have been presented from 2011 to 2021.

Results

The overall AQP scores improved indicating holistic enhancement of patient safety across Apollo Hospitals. Sustained progress, through the last nine years, was observed for various patient safety parameters in the AQP dashboard, across 41-hospitals of the network.

Conclusion

AQP is an innovative methodology that incorporates all the essential tenets of patient-safety. The programme led to a progressive improvement in patient-safety over the nine-years of its implementation. The enhancement was visible through compliance to the various parameters of AQP. The AQP empowered the leadership to retrospect and analyse each of their units’ performance for patient-safety and quality in systematic manner.

The Perception of Patient Safety Strategies by Primary Health Professionals

Almost all European citizens rank patient safety as very or fairly important in their country. However, few patient safety initiatives have been undertaken or implemented in Poland. The aim was to identify patient safety strategies perceived as important in Poland and compare them with those identified in an earlier Dutch study. A web-based survey was conducted among primary healthcare providers in Poland. The findings were compared with those obtained from eight other countries. The strategies regarded as most important in Poland included the use of integrated medical records for communication with specialists and others, patient-held medical records, acceptable workload in general practice, and availability of information technology. However, despite being seen as important, these strategies have not been widely implemented in Poland. This is the first study to identify strategies considered by primary care physicians in Poland to be important for improving patient safety. These strategies differed significantly from those indicated in other countries.

EPIDEMIOLOGICAL PROFILE AND OUTCOMES IN POSTOPERATIVE NEUROMUSCULAR ESCOLIOSIS

ABSTRACT Objective To outline the epidemiological profile and identify the hospital outcomes of patients submitted to neuromuscular scoliosis correction surgery. Methods This was a descriptive study that included 50 patients hospitalized following surgery for neuromuscular scoliosis in a tertiary-level hospital in São Paulo from January 2017 to July 2017. The variables were collected retrospectively from the patients’ medical records: age, sex, main diagnosis, length of hospital stay, duration of surgery, hospital complications, and mobility. Results Surgeries were performed in boys and girls in similar proportions, adolescents, many with cerebral palsy (42%), with mean hospital stay of 10.8 days. Fifty-two percent presented some complication, such as constipation. Infection of the surgical site was present in 12% of the sample. Forty-two percent had moderate to intense pain and only 2% did not achieve the proposed mobility goals. Conclusion We observed that the epidemiological profile presented data consistent with the scarce literature available, while the definitions of complications, incidence, and hospital outcomes available in the literature were varied quite a bit from the findings in this study. Level of evidence III; Retrospective study.

Monitoring quality of obstetric care from hospital discharge databases: A Delphi survey to propose a new set of indicators based on maternal health outcomes

Objectives

Most indicators proposed for assessing quality of care in obstetrics are process indicators and do not directly measure health effects, and cannot always be identified from routinely available databases. Our objective was to propose a set of indicators to assess the quality of hospital obstetric care from maternal morbidity outcomes identifiable in permanent hospital discharge databases.

Methods

Various maternal morbidity outcomes potentially reflecting quality of obstetric care were first selected from a systematic literature review. Then a three-round Delphi consensus survey was conducted online from 11/2016 through 02/2017 among a French panel of 37 expert obstetricians, anesthetists-critical-care specialists, midwives, quality-of-care researchers, and user representatives. For a given maternal outcome, several definitions could be proposed and the indicator (i.e. corresponding rate) could be applied to all women or restricted to specific subgroup(s).

Results

Of the 49 experts invited to participate, 37 agreed. The response rate was 92% in the second round and 97% in the third. Finally, a set of 13 indicators was selected to assess the quality of hospital obstetric care: rates of uterine rupture, postpartum hemorrhage, transfusion incident, severe perineal lacerations, episiotomy, cesarean, cesarean under general anesthesia, post-cesarean site infection, anesthesia-related complications, postpartum pulmonary embolism, maternal readmission and maternal mortality. Six were considered in specific subgroups, with, for example, the postpartum hemorrhage rate assessed among all women and also among women at low risk of PPH.

Implications

This Delphi process enabled us to define consensually a set of indicators to assess the quality of hospital obstetrics care from routine hospital data, based on maternal morbidity outcomes. Considering 6 of them in specific subgroups of women is especially interesting. These indicators, identifiable through codes used in international classifications, will be useful to monitor quality of care over time and across settings.

Contractual health services performance agreements for responsive health systems: from conception to implementation in the case of Qatar

Objective

Despite their use worldwide, strategy-based performance management is limited in the Eastern Mediterranean Region. This article explores Qatar's experience, the first from the Region, in implementing contractual agreements between healthcare providers and the regulator-Ministry of Public Health-to align strategy, performance and accountabilities.

Design

mixed-methods including tools development and pilot-testing, guided by performance management cycle with a focus on knowledge translation and key principles: feasibility; mandatory participation; participatory approach through Steering Committee.

Setting

All public, private and semi-governmental hospitals and primary healthcare centers.

Intervention(s)

(i) semi-structured interviews; (ii) review of 4982 indicators; (iii) Delphi technique for selecting indicators with > 80% agreement on importance and > 60% agreement on feasibility; (iv) capacity-building of providers and Ministry staff and 2-month pilot assessed by questionnaire with indicators scoring > 3 considered valid, reliable and feasible; and (v) 1-year grace period assessed by questionnaire.

Main Outcome Measure(s)

Approach strengths and challenges; Data collection and healthcare quality improvements.

Results

Contracts mandate reporting 25 hospital and 15 primary healthcare indicators to the regulator, which delivers confidential benchmarking reports to providers. Scorecards were discussed with the regulator for evidence-informed policymaking. The approach uncovered system-related challenges and learning for public and private sectors: providers commended the participatory approach (82%) and indicated that contracts enabled collecting valid and timely data (64%) and improved healthcare quality (55%).

Conclusion

This experience provides insights for countries implementing performance management, responsive regulation and public-private partnerships. It suggests that contractual agreements can be useful, despite their mandatory nature, if clear principles are applied early on.

A Safety-II Perspective on Organisational Learning in Healthcare Organisations Comment on "False Dawns and New Horizons in Patient Safety Research and Practice"

In their recent editorial Mannion and Braithwaite provide an insightful critique of traditional patient safety improvement efforts, and offer a powerful alternative vision based on Safety-II thinking that has the potential to radically transform the way we approach patient safety. In this commentary, I explore how the Safety-II perspective points to new directions for organisational learning in healthcare organisations. Current approaches to organisational learning adopted by healthcare organisations have had limited success in improving patient safety. I argue that these approaches learn about the wrong things, and in the wrong way. I conclude that organisational learning in healthcare organisations should provide deeper understanding of the adaptations healthcare workers make in their everyday clinical work, and that learning and improvement approaches should be more democratic by promoting participation and ownership among a broader range of stakeholders as well as patients.

Quality of pharmaceutical care in surgical patients

Background

Surgical patients are at risk for preventable adverse drug events (ADEs) during hospitalization. Usually, preventable ADEs are measured as an outcome parameter of quality of pharmaceutical care. However, process measures such as QIs are more efficient to assess the quality of care and provide more information about potential quality improvements.

Objective

To assess the quality of pharmaceutical care of medication-related processes in surgical wards with quality indicators, in order to detect targets for quality improvements.

Methods

For this observational cohort study, quality indicators were composed, validated, tested, and applied on a surgical cohort. Three surgical wards of an academic hospital in the Netherlands (Academic Medical Centre, Amsterdam) participated. Consecutive elective surgical patients with a hospital stay longer than 48 hours were included from April until June 2009. To assess the quality of pharmaceutical care, the set of quality indicators was applied to 252 medical records of surgical patients.

Results

Thirty-four quality indicators were composed and tested on acceptability and content- and face-validity. The selected 28 candidate quality indicators were tested for feasibility and ‘sensitivity to change’. This resulted in a final set of 27 quality indicators, of which inter-rater agreements were calculated (kappa 0.92 for eligibility, 0.74 for pass-rate). The quality of pharmaceutical care was assessed in 252 surgical patients. Nearly half of the surgical patients passed the quality indicators for pharmaceutical care (overall pass rate 49.8%). Improvements should be predominantly targeted to medication care related processes in surgical patients with gastro-intestinal problems (domain pass rate 29.4%).

Conclusions

This quality indicator set can be used to measure quality of pharmaceutical care and detect targets for quality improvements. With these results medication safety in surgical patients can be enhanced.

Evidence-based organization and patient safety strategies in European hospitals

OBJECTIVE

To explore how European hospitals have implemented patient safety strategies (PSS) and evidence-based organization of care pathway (EBOP) recommendations and examine the extent to which implementation varies between countries and hospitals.

DESIGN

Mixed-method multilevel cross-sectional design in seven countries as part of the European Union-funded project 'Deepening our Understanding of Quality improvement in Europe' (DUQuE).

SETTING AND PARTICIPANTS

Seventy-four acute care hospitals with 292 departments managing acute myocardial infarction (AMI), hip fracture, stroke, and obstetric deliveries. Main outcome measure Five multi-item composite measures-one generic measure for PSS and four pathway-specific measures for EBOP.

RESULTS

Potassium chloride had only been removed from general medication stocks in 9.4-30.5% of different pathways wards and patients were adequately identified with wristband in 43.0-59.7%. Although 86.3% of areas treating AMI patients had immediate access to a specialist physician, only 56.0% had arrangements for patients to receive thrombolysis within 30 min of arrival at the hospital. A substantial amount of the total variance observed was due to between-hospital differences in the same country for PSS (65.9%). In EBOP, between-country differences play also an important role (10.1% in AMI to 57.1% in hip fracture).

CONCLUSIONS

There were substantial gaps between evidence and practice of PSS and EBOP in a sample of European hospitals and variations due to country differences are more important in EBOP than in PSS, but less important than within-country variations. Agencies supporting the implementation of PSS and EBOP should closely re-examine the effectiveness of their current strategies.

Internal consistency, factor structure and construct validity of the French version of the Hospital Survey on Patient Safety Culture

OBJECTIVE

To assess the psychometric properties of the French-language version of the Hospital Survey on Patient Safety Culture (HSOPSC).

METHODS

Data were obtained from a staff survey at a Swiss multisite hospital. We computed descriptive statistics and internal consistency coefficients, then conducted a confirmatory and exploratory factor analysis, and performed construct validity tests.

RESULTS

1171 staff members participated (response rate 74%). The internal consistency coefficients of the 12 dimension scores ranged from 0.57 to 0.86 (median 0.73). Confirmatory factor analysis indicated a reasonable but not perfect fit of the hypothesised measurement model (root mean square error of approximation 0.043, comparative fit index 0.89). Exploratory data analysis suggested 10 dimensions instead of 12, grouping items from teamwork across hospital units with those of hospital handoffs and transitions, and items from communication openness with those of feedback and communication about error. However, the loading pattern was clean: 41 of 42 main loadings exceeded 0.40, and only 3 of 378 cross-loadings exceeded 0.30. All 10 process scores were higher among respondents who rated the global safety grade as 'excellent' or 'very good' rather than 'good', 'fair' or 'poor' (effect sizes 0.41-0.79, all p<0.001), but score differences between those who have and have not reported an incident in the past year were weak or inconsistent with theory.

DISCUSSION

The French version of the HSOPSC did not perform as well as the original in standard psychometric analyses.

Satisfactory reliability among nursing students using the instrument PVC ASSESS to evaluate management of peripheral venous catheters

PURPOSE

Nursing students should be given opportunities to participate in clinical audits during their education. However, audit tools are seldom tested for reliability among nursing students. The aim of this study was to present reliability among nursing students using the instrument PVC assess to assess management of peripheral venous catheters (PVCs) and PVC-related signs of thrombophlebitis.

METHODS

PVC assess was used to assess 67 inserted PVCs in 60 patients at ten wards at a university hospital. One group of nursing students (n=4) assessed PVCs at the bedside (inter-rater reliability) and photographs of these PVCs were taken. Another group of students (n=3) assessed the PVCs in the photographs after 4 weeks (test-retest reliability). To determine reliability, proportion of agreement [P(A)] and Cohen's kappa coefficient (κ) were calculated.

RESULTS

For bedside assessment of PVCs, P(A) ranged from good to excellent (0.80-1.0) in 55% of the 26 PVC assess items that were tested. P(A) was poor (<0.70) for two items: "adherence of inner dressing to the skin" and "PVC location." In 81% of the items, κ was between moderate and almost perfect: moderate (n=5), substantial (n=3), almost perfect (n=5). For edema at insertion site and two items on PVC dressing, κ was fair (0.21-0.40). Regarding test-retest reliability, P(A) varied between good and excellent (0.81-1) in 85%-95% of the items, and the κ ranged between moderate and almost perfect (0.41-1) in 90%-95%.

CONCLUSIONS

PVC assess demonstrated satisfactory reliability among nursing students. However, students need training in how to use the instrument before assessing PVCs.

Quality improvement programme, focusing on error reduction: a single center naturalistic study

Objectives

Interventions to drive quality of care using strategies to empower clinical staff with personal and local performance indicators should lead to measurable improvements in outcome. The current evidence for the linkage of quality metrics and patient outcome usually relies on surrogate measures. There is a continuing need for the development of specific measurable indicators of quality of care, which have demonstrable links to patient outcome.

Design

A single centre naturalistic study to validate electronically collected drug administration and documentation measures of quality improvement, during the introduction of a quality improvement programme.

Setting

A large academic teaching hospital in the UK.

Participants

Staff involved in administration of prescribed medication using an in-house developed prescribing information and communication system (PICS).

Main outcome measures

Mortality data from nationally collected ‘hospital episode statistics’ and markers of the precision of medicines administration and documentation ‘uncharted’ and ‘missed’ drug doses.

Results

A 16.2% reduction in local mortality rate was demonstrated ( P=0.013) compared to static mortality rates throughout England. Similar temporal reductions were seen in the rates of missed and uncharted doses of medication at the hospital over the same period.

Conclusions

When monitored as part of a quality improvement strategy, ‘missed’ and ‘uncharted’ drug dose information may reflect wider institutional changes and act as a valid indicator of quality of healthcare more generally.

Implementation of patient safety strategies in European hospitals

CONTEXT

This study is part of the Methods of Assessing Response to Quality Improvement Strategies (MARQuIS) research project on cross-border care, investigating quality improvement strategies in healthcare systems across the European Union (EU).

AIM

To explore to what extent a sample of acute care European hospitals have implemented patient safety strategies and mechanisms and whether the implementation is related to the type of hospital.

METHODS

Data were collected on patient safety structures and mechanisms in 389 acute care hospitals in eight EU countries using a web-based questionnaire. Subsequently, an on-site audit was carried out by independent surveyors in 89 of these hospitals to assess patient safety outputs. This paper presents univariate and bivariate statistics on the implementation and explores the associations between implementation of patient safety strategies and hospital type using the chi(2) test and Fisher exact test.

RESULTS

Structures and plans for safety (including responsibilities regarding patient safety management) are well developed in most of the hospitals that participated in this study. The study found greater variation regarding the implementation of mechanisms or activities to promote patient safety, such as electronic drug prescription systems, guidelines for prevention of wrong patient, wrong site and wrong surgical procedure, and adverse events reporting systems. In the sample of hospitals that underwent audit, a considerable proportion do not comply with basic patient safety strategies--for example, using bracelets for adult patient identification and correct labelling of medication.