Applying the Global Trigger Tool in German Hospitals: A Pilot in Surgery and Neurosurgery

[Safety of patient care on an interprofessional training ward in visceral surgery]

BACKGROUND

Interprofessional training wards (ITW) are increasingly being integrated into teaching and training concepts in visceral surgery clinics.

OBJECTIVE

How safe is patient care on an ITW in visceral surgery?

MATERIAL AND METHODS

Data collection took place from November 2021 to December 2022. In this nonrandomized prospective evaluation study the frequency and severity of adverse events (AE) in 3 groups of 100 patients each in a tertiary referral center hospital for visceral surgery were investigated. The groups consisted of patients on the ITW and on the conventional ward before and after implementation of the ITW. The Global Trigger Tool (GTT) was used to search for AE. Simultaneously, a survey of the treatment was conducted according to the Picker method to measure patient reported outcome.

RESULTS

Baseline characteristics and clinical outcome parameters of the patients in the three groups were comparable. The GTT analysis found 74 nonpreventable and 5 preventable AE in 63 (21%) of the patients and 12 AE occurred before the hospital stay. During the hospital stay 50 AE occurred in the operating theater and 17 on the conventional ward. None of the five preventable AE (in 1.7% of the patients) was caused by the treatment on the ITW. Patients rated the safety on the ITW better than in 90% of the hospitals included in the Picker benchmark cohort and as good as on the normal ward.

CONCLUSION

The GTT-based data as well as from the patients' point of view show that patient care on a carefully implemented ITW in visceral surgery is safe.

Comparing rates of adverse events detected in incident reporting and the Global Trigger Tool: a systematic review

Many hospitals continue to use incident reporting systems (IRSs) as their primary patient safety data source. The information IRSs collect on the frequency of harm to patients [adverse events (AEs)] is generally of poor quality, and some incident types (e.g. diagnostic errors) are under-reported. Other methods of collecting patient safety information using medical record review, such as the Global Trigger Tool (GTT), have been developed. The aim of this study was to undertake a systematic review to empirically quantify the gap between the percentage of AEs detected using the GTT to those that are also detected via IRSs. The review was conducted in adherence to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. Studies published in English, which collected AE data using the GTT and IRSs, were included. In total, 14 studies met the inclusion criteria. All studies were undertaken in hospitals and were published between 2006 and 2022. The studies were conducted in six countries, mainly in the USA (nine studies). Studies reviewed 22 589 medical records using the GTT across 107 institutions finding 7166 AEs. The percentage of AEs detected using the GTT that were also detected in corresponding IRSs ranged from 0% to 37.4% with an average of 7.0% (SD 9.1; median 3.9 and IQR 5.2). Twelve of the fourteen studies found <10% of the AEs detected using the GTT were also found in corresponding IRSs. The >10-fold gap between the detection rates of the GTT and IRSs is strong evidence that the rate of AEs collected in IRSs in hospitals should not be used to measure or as a proxy for the level of safety of a hospital. IRSs should be recognized for their strengths which are to detect rare, serious, and new incident types and to enable analysis of contributing and contextual factors to develop preventive and corrective strategies. Health systems should use multiple patient safety data sources to prioritize interventions and promote a cycle of action and improvement based on data rather than merely just collecting and analysing information.

Estonian adverse events study for multimorbid patients using Estonian Trigger Tool (MUPETT-MUltimorbid Patients-Estonian Trigger Tool). Development of Estonian trigger tool for multimorbid patients. A study protocol for mixed-methods study

INTRODUCTION

It is widely recognized that providing healthcare may produce harm to the patient. Different approaches have been developed to measure the burden of adverse events (AEs) to plan and measure the effects of interventions. One of the most widely used instruments is the Trigger Tool, which has previously been modified to be used on various settings and translated into many languages. Multimorbidity complicates care and may increase the number of AEs patients experience. Currently there is no instrument designed to measure AEs in multimorbid patients. In Estonia, there is currently no validated instrument to measure the burden of AEs.

AIMS

The aim of this study will be evaluating the characteristics and ocurrence of AEs in multimorbid patients in hospitalised internal medicine patients of Estonia, and describes the development of a trigger tool for this purpose.

METHODS AND ANALYSIS

We will search for the evidence on measuring AEs in the population of multimorbid patients focusing on trigger tools, and synthesize the data. Data collection of the triggers from the literature will be followed by translating triggers from English to Estonian. An expert multidisciplinary panel will select the suitable triggers for this population. Trigger tool will be pre-tested to assess agreement among professionals and usability of the tool. Validation will be done using 90 medical records. A cross-sectional study in internal medicine departments of two Estonian tertiary care hospitals will be performed to identify the frequency and characteristics of AEs in 960 medical records. We will also provide preventability potential and influencing factors.

DISSEMINATION

Results will be disseminated to healthcare providers and stakeholders at national and international conferences, and as a doctoral medical thesis.

Variation in detected adverse events using trigger tools: A systematic review and meta-analysis

Background

Adverse event (AE) detection is a major patient safety priority. However, despite extensive research on AEs, reported incidence rates vary widely.

Objective

This study aimed: (1) to synthesize available evidence on AE incidence in acute care inpatient settings using Trigger Tool methodology; and (2) to explore whether study characteristics and study quality explain variations in reported AE incidence.

Design

Systematic review and meta-analysis.

Methods

To identify relevant studies, we queried PubMed, EMBASE, CINAHL, Cochrane Library and three journals in the patient safety field (last update search 25.05.2022). Eligible publications fulfilled the following criteria: adult inpatient samples; acute care hospital settings; Trigger Tool methodology; focus on specialty of internal medicine, surgery or oncology; published in English, French, German, Italian or Spanish. Systematic reviews and studies addressing adverse drug events or exclusively deceased patients were excluded. Risk of bias was assessed using an adapted version of the Quality Assessment Tool for Diagnostic Accuracy Studies 2. Our main outcome of interest was AEs per 100 admissions. We assessed nine study characteristics plus study quality as potential sources of variation using random regression models. We received no funding and did not register this review.

Results

Screening 6,685 publications yielded 54 eligible studies covering 194,470 admissions. The cumulative AE incidence was 30.0 per 100 admissions (95% CI 23.9–37.5; I² = 99.7%) and between study heterogeneity was high with a prediction interval of 5.4–164.7. Overall studies’ risk of bias and applicability-related concerns were rated as low. Eight out of nine methodological study characteristics did explain some variation of reported AE rates, such as patient age and type of hospital. Also, study quality did explain variation.

Conclusion

Estimates of AE studies using trigger tool methodology vary while explaining variation is seriously hampered by the low standards of reporting such as the timeframe of AE detection. Specific reporting guidelines for studies using retrospective medical record review methodology are necessary to strengthen the current evidence base and to help explain between study variation.

Translation, cross-cultural adaptation and content validation of the Global Trigger Tool surgical module

OBJECTIVE

to translate, cross-culturally adapt and validate the Global Trigger Tool surgical module content for Brazil.

METHOD

this is methodological research, carried out between March/2018 and February/2019, following the steps of translation, synthesis, back-translation, validation by the Delphi technique, pre-test and presentation to developers. Two translators, two back-translators, six professionals participated in the expert committee. A pre-test was carried out with a retrospective analysis of 244 medical records of adult patients. The content validity index and Cronbach's alpha were determined for data analysis.

RESULTS

the translation and cross-cultural adaptation allowed adjustments of items for use in Brazil. The mean Content Validity Index was 1.38, and the degree of agreement among experts was 92.4%. Cronbach's alpha was 0.83 for the 11 surgical triggers and their guidelines.

CONCLUSION

the module was translated, cross-culturally adapted for Brazil, with high reliability to identify surgical adverse events.

A Risk-Factor Model for Antineoplastic Drug-Induced Serious Adverse Events in Cancer Inpatients: A Retrospective Study Based on the Global Trigger Tool and Machine Learning

The objective of this study was to apply a machine learning method to evaluate the risk factors associated with serious adverse events (SAEs) and predict the occurrence of SAEs in cancer inpatients using antineoplastic drugs. A retrospective review of the medical records of 499 patients diagnosed with cancer admitted between January 1 and December 31, 2017, was performed. First, the Global Trigger Tool (GTT) was used to actively monitor adverse drug events (ADEs) and SAEs caused by antineoplastic drugs and take the number of positive triggers as an intermediate variable. Subsequently, risk factors with statistical significance were selected by univariate analysis and least absolute shrinkage and selection operator (LASSO) analysis. Finally, using the risk factors after the LASSO analysis as covariates, a nomogram based on a logistic model, extreme gradient boosting (XGBoost), categorical boosting (CatBoost), adaptive boosting (AdaBoost), light-gradient-boosting machine (LightGBM), random forest (RF), gradient-boosting decision tree (GBDT), decision tree (DT), and ensemble model based on seven algorithms were used to establish the prediction models. A series of indicators such as the area under the ROC curve (AUROC) and the area under the PR curve (AUPR) was used to evaluate the model performance. A total of 94 SAE patients were identified in our samples. Risk factors of SAEs were the number of triggers, length of stay, age, number of combined drugs, ADEs occurred in previous chemotherapy, and sex. In the test cohort, a nomogram based on the logistic model owns the AUROC of 0.799 and owns the AUPR of 0.527. The GBDT has the best predicting abilities (AUROC = 0.832 and AUPR = 0.557) among the eight machine learning models and was better than the nomogram and was chosen to establish the prediction webpage. This study provides a novel method to accurately predict SAE occurrence in cancer inpatients.

Tradução, adaptação transcultural e validação de conteúdo do módulo cirúrgico do Global Trigger Tool

RESUMO Objetivo: traduzir, adaptar transculturalmente e validar o conteúdo do módulo cirúrgico do Global Trigger Tool para o Brasil. Método: pesquisa metodológica, realizada entre março/2018 e fevereiro/2019, seguindo os passos de tradução, síntese, retrotradução, validação pela técnica Delphi, pré-teste e apresentação para os desenvolvedores. Participaram dois tradutores, dois retrotradutores, seis profissionais para o comitê de especialistas. Realizou-se o pré-teste com análise retrospectiva de 244 prontuários de pacientes adultos. Determinou-se o índice de validade de conteúdo e alfa de Cronbach para análise dos dados. Resultados: a tradução e a adaptação transcultural permitiram ajustes dos itens para uso no Brasil. O Índice de Validade de Conteúdo médio foi 1,38, e grau de concordância entre os especialistas, 92,4 %. O alfa de Cronbach foi 0,83 para os 11 triggers cirúrgicos e respectivas orientações. Conclusão: o módulo foi traduzido e adaptado transculturalmente para o Brasil, com alta confiabilidade para identificar eventos adversos cirúrgicos.

Health Systems Factors Associated With Adverse Events Among Hospitalized Obstetric Clients in a Tertiary Health Care Facility in Ghana

OBJECTIVES

The risk of an adverse event (AE) in obstetric clients receiving care in hospitals is greater than the risk of dying in aviation, road traffic accidents, and breast cancer. There is little understanding of AEs with respect to their causes at hospitals. The study aimed at assessing factors that are associated with the occurrence of AEs among hospitalized obstetric clients in a tertiary hospital in Ghana.

METHOD

This was a case-control study of 650 obstetric clients (equal number in both arms) who were admitted between January 1 and December 31, 2015, at the study site. A retrospective review of the clients' medical records was randomly allocated into both arms of the study. Descriptive and inferential statistics including confirmatory factor analysis were performed. Models were evaluated for goodness-of-fit measures. The reliability and validity of the scale were also tested using Cronbach α coefficient.

RESULTS

The mean gestational age of the clients was 37.4 ± 4.9 weeks. Leadership and governance (inadequate use of protocol and adherence) accounted for the most cause of AEs among obstetric clients. The overall Kaiser-Meyer-Olkin score was also 0.87. The scale also demonstrated high reliability (Cronbach α = 0.995; composite reliability > 0.7) and validity (average variance extraction > 0.50). There was a marginal model fit (root mean square error of approximation, 0.067), and the χ2 test was statistically significant (P < 0.05).

CONCLUSIONS

Inadequate use of protocol and adherence is a major cause of preventable AEs identified in this study. There is an urgent need to address this to ensure a reduction in the prevalence of AEs among obstetric clients.

Critical event debriefing: a checklist for the aftermath

PURPOSE OF REVIEW

Millions of perioperative crises (e.g. anaphylaxis, cardiac arrest) may occur annually. Critical event debriefing can offer benefits to the individual, team, and system, yet only a fraction of perioperative critical events are debriefed in real-time. This publication aims to review evidence-based best practices for proximal critical event debriefing.

RECENT FINDINGS

Evidence-based key processes to consider for proximal critical event debriefing can be summarized by the WATER mnemonic: Welfare check (assessing team members' emotional and physical wellbeing to continue providing care); Acute/short-term corrections (matters to be addressed before the next case); Team reactions and reflections (summarizing case; listening to team member reactions; plus/delta conversation); Education (lessons learned from the event and debriefing); Resource awareness and longer term needs [follow-up (e.g. safety/quality improvement report), local peer-support and employee assistance resources]. A cognitive aid to accompany this mnemonic is provided with the publication.

SUMMARY

There is growing literature on how to conduct proximal perioperative critical event debriefing. Evidence-based best practices, as well as a cognitive aid to apply them, may help bridge the gap between theory and clinical practice. In this era of increased attention to burnout and wellness, the consideration of interventions to improve the quality and frequency of critical event debriefing is paramount.

Translation, Cross-Cultural Adaptation, and Measurement Properties of the Portuguese Version of the Global Trigger Tool for Adverse Events

Purpose

To adapt and validate the Global Trigger Tool (IHI-GTT), which identifies and analyzes adverse events (AE) in hospitalized patients and their measurement properties in the Portuguese context.

Methods

A retrospective cross-sectional study was based on a random sample of 90 medical records. The stages of translation and cross-cultural adaptation of the IHI-GTT were based on the Cross-Cultural Adaptation Protocol that originated from the Portuguese version, GTT-PT, for the hospital context in medical-surgical departments. Internal consistency, reliability, reproducibility, diagnostic tests, and discriminatory predictive value were investigated.

Results

The final phase of the GTT-PT showed insignificant inconsistencies. The pre-test phase confirmed translation accuracy, easy administration, effectiveness in identifying AEs, and relevance of integrating it into hospital risk management. It had a sensitivity of 97.8% and specificity of 74.8%, with a cutoff point of 0.5, an accuracy of 83%, and a positive predictive value of 69.8% and a negative predictive value of 0.98%.

Conclusion

The GTT-PT is a reliable, accurate, and valid tool to identify AE, with robust measurement properties.

[Teaching patient safety during undergraduate medical studies]

BACKGROUND

In the professional public there is agreement that healthcare professionals worldwide should already be prepared for safety in patient care during their education.

OBJECTIVE

How can the topic of patient safety be successfully integrated into the curricula of healthcare professions?

MATERIAL AND METHODS

Overview of the Marburg curriculum on patient safety during the practical year as well as of other approaches to teaching patient safety described in the literature.

RESULTS

In recent years teaching initiatives on patient safety have significantly increased; however, they are still not comprehensively distributed in German-speaking countries or throughout Europe. In the context of implementation, the multiprofessional edition of the World Health Organization (WHO) patient safety curriculum guide may be used as guideline. A current, very promising development in connection with acquiring and examining the competences that are necessary for safe patient care is the establishment of interprofessional training wards.

CONCLUSION

In the meantime, there are clearly defined strategies for the integration of the topic of patient safety into the curricula of healthcare professionals. On the way towards a successful restructuring of the curricula including the necessary competences and behavioral changes of the students, however, relevant support by the management of faculties and teaching hospitals is essential.