Characteristics associated with the occurrence of adverse events: a retrospective medical record review using the Global Trigger Tool in a fully digitalized tertiary teaching hospital in Korea

Active monitoring of antifungal adverse events in hospitalized patients based on Global Trigger Tool method

Background

The increasing prevalence of fungal infections necessitates broader use of antifungal medications. However, the prevalence of adverse drug events (ADEs) restricts their clinical application. This study aimed to develop a reliable ADEs trigger for antifungals to enable proactive ADEs monitoring, serving as a reference for ADEs prevention and control.

Methods

This investigation comprises two phases. Initially, the trigger was established via a literature review, extraction of relevant items, and refinement through Delphi expert consultation. Subsequently, the validity of the trigger was assessed by analyzing hospital records of antifungal drug users from 1 January 2019 to 31 December 2020. The correlation between each trigger signal and ADEs occurrence was examined, and the sensitivity and specificity of the trigger were evaluated through the spontaneous reporting system (SRS) and Global Trigger Tool (GTT). Additionally, risk factors contributing to adverse drug events (ADEs) resulting from antifungal use were analyzed. Results: Twenty-one preliminary triggers were refined into 21 final triggers after one expert round. In the retrospective analysis, the positive trigger rate was 65.83%, with a positive predictive value (PPV) of 28.75%. The incidence of ADEs in inpatients was 28.75%, equating to 44.58 ADEs per 100 admissions and 33.04 ADEs per 1,000 patient days. Predominant ADEs categories included metabolic disturbances, gastrointestinal damage, and skin rashes. ADEs severity was classified into 36 cases at grade 1, 160 at grade 2, and 18 at grade 3. The likelihood of ADEs increased with longer stays, more positive triggers, and greater comorbidity counts.

Conclusion

This study underscores the effectiveness of the GTT in enhancing ADEs detection during antifungal medication use, thereby confirming its value as a monitoring tool.

Patient Safety Incidents in Operating Rooms Reported in the Past Five Years (2017-2021) in Korea

Purpose

Patient safety incidents in the operating room require special attention because they can cause catastrophic and irreversible conditions in patients. Although patient safety incidents have different characteristics, there may be similarities and patterns of risk factors that may be common. Therefore, this study analyzed factors associated with the PSIs by analyzing data from the Korean Patient Safety Reports from 2017 to 2019.

Methods

The "Patient Safety Incidents Data from 2017 to 2021" systematically collected by the Korea Institute for Healthcare Accreditation, include patient safety incident reports from medical institutions. Data on 1140 patient safety incidents in the operating room were analyzed. They included patients' gender and age, Hospital size, Incident seasons, incident time, Incident reporter, incident type, Medical department, and Incident severity. The Incident severity was analyzed by dividing it into three stages: near miss, adverse event, sentinel event, which are applied by domestic medical institutions.

Results

The highest number of OR patient safety incidents were related to surgery and anesthesia. On analyzing the probability of adverse events based on near misses, the significant variables were patient gender, incident reporter, incident type, and Medical department. Additionally, the factors that were likely to precipitate sentinel events based on near misses were patient gender, incident time, reporter, and incident type.

Conclusion

To prevent sentinel events in Patient safety incidents, female and during night shifts are required to pay close attention. Moreover, it is necessary to establish a patient safety reporting system in which not only all medical personnel, but also patients, generally, can actively participate in patient safety activities.

Establishing a trigger tool based on global trigger tools to identify adverse drug events in obstetric inpatients in China

BACKGROUND

Pregnant women belong to the special population of drug therapy, and their physiological state, pharmacokinetics and pharmacodynamics are significantly different from the general population. Drug safety during pregnancy involves two generations, which is a hot issue widely concerned in the whole society. Global Trigger Tool (GTT) of the Institute for Healthcare Improvement (IHI) has been wildly used as a patient safety measurement strategy by several institutions and national programs, and the effectiveness had been demonstrated. But only one study reports the use of GTT in obstetric delivery until now. The aim of the study is to establish triggers detecting adverse drug events (ADEs) suitable for obstetric inpatients on the basis of the GTT, to examine the performance of the obstetric triggers in detecting ADEs experienced by obstetric units compared with the spontaneous reporting system and GTT, and to assess the utility and value of the obstetric trigger tool in identifying ADEs of obstetric inpatients.

METHODS

Based on a literature review searched in PubMed and CNKI from January of 1997 to October of 2023, retrospective local obstetric ADEs investigations, relevant obstetric guidelines and the common adverse reactions of obstetric therapeutic drugs were involved to establish the initial obstetric triggers. According to the Delphi method, two rounds of expert questionnaire survey were conducted among 16 obstetric and neonatological physicians and pharmacists until an agreement was reached. A retrospective study was conducted to identity ADEs in 300 obstetric inpatient records at the Sichuan Academy of Medical Sciences & Sichuan Provincial People's Hospital from June 1 to September 30, 2018. Two trained junior pharmacists analyzed the first eligible records independently, and the included records reviewed by trained pharmacist and physician to identify ADEs. Sensitivity and specificity of the established obstetric triggers were assessed by the number of ADEs/100 patients and positive predictive value with the spontaneous reporting system (SRS) and GTT. Excel 2010 and SPSS22 were used for data analysis.

RESULTS

Through two rounds of expert investigation, 39 preliminary triggers were established that comprised four modules (12 laboratory tests, 9 medications, 14 symptoms, and 4 outcomes). A total of 300 medical records were reviewed through the obstetric triggers, of which 48 cases of ADEs were detected, with an incidence of ADEs of 16%. Among the 39 obstetric triggers, 22 (56.41%) were positive and 11 of them detected ADEs. The positive predictive value (PPV) was 36.36%, and the number of ADEs/100 patients was 16.33 (95% CI, 4.19-17.81). The ADE detection rate, positive trigger rate, and PPV for the obstetric triggers were significantly augmented, confirming that the obstetric triggers were more specific and sensitive than SRS and GTT.

CONCLUSION

The obstetric triggers were proven to be sensitive and specific in the active monitoring of ADE for obstetric inpatients, which might serve as a reference for ADE detection of obstetric inpatients at medical institutions.

Adverse drug events in Chinese elder inpatients: a retrospective review for evaluating the efficiency of the Global Trigger Tool

Background

Elderly patients frequently experience a high incidence of adverse drug events (ADEs) due to the coexistence of multiple diseases, the combination of various medications, poor medication compliance, and other factors. Global Trigger Tool (GTT) is a new method for identifying ADEs, introducing the concept of a trigger, that is, clues including abnormal laboratory values, reversal drugs, and clinical symptoms that may suggest ADEs, and specifically locating information related to ADEs in the medical record to identify ADEs. The aim of this study was to establish a GTT-based trigger tool for adverse medication events in elderly patients and to investigate the risk variables associated with such events.

Methods

The triggers were identified by reviewing the frequency of ADEs in elderly patients in Sichuan, China, retrieving relevant literature, and consulting experts. A retrospective analysis was carried out to identify adverse medication occurrences among 480 elderly inpatients in Sichuan People's Hospital.

Results

A total of 56 ADEs were detected in 51 patients (10.62%), 13.04 per 1,000 patient days, and 11.67 per 100 admissions. The overall positive predictive value (PPV) of the triggers was 23.84, and 94.64% of ADEs caused temporary injury. Gastrointestinal system injury (27.87%) and metabolic and nutritional disorders (24.53%) were the primary organ-systems affected by ADEs. The majority of ADEs were caused by drugs used to treat cardiovascular diseases. 71.43% of ADE occurred within 2 days of administration and the risk factor analysis of ADE revealed that the number of medicines had a significant correlation.

Conclusion

This study demonstrated GTT's value as a tool for ADEs detection in elderly inpatients in China. It enhances the level of medication management and comprehensively reflects the situation of ADE of the elderly.

Patient safety value, safety attitude and safety competency among emergency nurses in China: A structural equation model analysis

AIMS

We aim to determine the levels of patient safety value, safety attitude and safety competency and to explore the associations among these variables in emergency nurses in China.

BACKGROUND

Studies have focused on the individual characteristics of nurses as influencing factors of patient safety but not on the factors that may affect patient safety competency in the context of Chinese culture, such as safety value and safety attitude.

METHOD

A cross-sectional survey was conducted among emergency nurses in 22 hospitals.

RESULTS

The final model had acceptable fit indices (χ² /df = 3.512 < 5; CFI = 0.955 > 0.9; TLI = 0.942 > 0.9; IFI = 0.955 > 0.9; RMSEA = 0.068 < 0.08 [90% CI, 0.059 to 0.077]). A fully adjusted model was also tested, and the effects among variables were consistent with the hypothesized model. The SEM results showed that patient safety values had a significant direct effect on safety competency (b = .407, p < .001) and safety attitude (b = .656, p < .001). Patient safety attitude had a significant direct effect on safety competency (b = .493, p < .001). Patient safety values had an indirect effect on safety competency through safety attitude, and the total effect of safety values on safety competency was 0.730.

CONCLUSIONS

Chinese nurses are at a moderate level of patient safety attitude and competency. Emergency nurses' safety value and safety attitude can be direct predictors of patient safety competency, and safety value can indirectly predict their patient safety competency through safety attitude.

IMPLICATIONS FOR NURSING MANAGEMENT

Strengthening safety value is a critical step toward improving patient safety competency. Hospital administrators and educators should construct a patient safety culture that is guided and driven by appropriate values and ensure the development of necessary competencies in nurses.

Variation in detected adverse events using trigger tools: A systematic review and meta-analysis

Background

Adverse event (AE) detection is a major patient safety priority. However, despite extensive research on AEs, reported incidence rates vary widely.

Objective

This study aimed: (1) to synthesize available evidence on AE incidence in acute care inpatient settings using Trigger Tool methodology; and (2) to explore whether study characteristics and study quality explain variations in reported AE incidence.

Design

Systematic review and meta-analysis.

Methods

To identify relevant studies, we queried PubMed, EMBASE, CINAHL, Cochrane Library and three journals in the patient safety field (last update search 25.05.2022). Eligible publications fulfilled the following criteria: adult inpatient samples; acute care hospital settings; Trigger Tool methodology; focus on specialty of internal medicine, surgery or oncology; published in English, French, German, Italian or Spanish. Systematic reviews and studies addressing adverse drug events or exclusively deceased patients were excluded. Risk of bias was assessed using an adapted version of the Quality Assessment Tool for Diagnostic Accuracy Studies 2. Our main outcome of interest was AEs per 100 admissions. We assessed nine study characteristics plus study quality as potential sources of variation using random regression models. We received no funding and did not register this review.

Results

Screening 6,685 publications yielded 54 eligible studies covering 194,470 admissions. The cumulative AE incidence was 30.0 per 100 admissions (95% CI 23.9–37.5; I² = 99.7%) and between study heterogeneity was high with a prediction interval of 5.4–164.7. Overall studies’ risk of bias and applicability-related concerns were rated as low. Eight out of nine methodological study characteristics did explain some variation of reported AE rates, such as patient age and type of hospital. Also, study quality did explain variation.

Conclusion

Estimates of AE studies using trigger tool methodology vary while explaining variation is seriously hampered by the low standards of reporting such as the timeframe of AE detection. Specific reporting guidelines for studies using retrospective medical record review methodology are necessary to strengthen the current evidence base and to help explain between study variation.

Development and Adjustment of an Algorithm for Identifying Drug-Related Hospital Admissions in Pediatrics

OBJECTIVE

Adverse drug events (ADEs) in the outpatient pediatric pharmacotherapy can be serious and lead to inpatient admissions. Recent research only focused on ADE identification during hospitalization. The aim of the present study was to develop an algorithm to identify drug-related hospital admissions in pediatrics.

METHODS

A systematic literature research was performed, and a pediatric trigger tool for identifying drug-related inpatient admissions was built. The initial version was tested in a sample of 292 patients admitted to a German university children's hospital. Subsequently, the tool was further improved by combining different modules as a novel approach.

RESULTS

The obtained algorithm with 39 triggers in 5 modules identified drug-related inpatient admissions at a sensitivity of 95.5% (95% confidence interval [CI], 89.3%-100%) and a specificity of 16.5% (95% CI, 11.9%-21.2%), respectively. After modifications including trigger activation requiring a combination of different modules, specificity increased to 56.9% (95% CI, 50.7%-63.0%). Identifying 36 of 44 ADEs leading to admission, sensitivity remained high (81.8% [95% CI, 70.4%-93.2%]). The overall positive predictive value was 25.2% (95% CI, 18.1%-32.3%).

CONCLUSIONS

The algorithm is the first trigger tool to identify ambulant acquired ADEs leading to hospital admission in pediatrics. However, the underlying patient sample is small.Using a larger population for refinement will allow further specifications and reduction in the total amount of triggers and thus signals.

The Korea National Patient Safety Incidents Inquiry Survey: Feasibility of Medical Record Review for Detecting Adverse Events in Regional Public Hospitals

OBJECTIVES

We aimed to examine the Korea National Patient Safety Incidents Inquiry conducted in the Republic of Korea; specifically, we assessed the validity of screening criteria, interreviewer reliability, quality of medical records, and the time required for reviewing medical records.

METHODS

A 3-stage retrospective medical record review was performed. The sensitivity and positive predictive value of the screening criteria for the adverse events were calculated, and interreviewer reliability was verified using the overall agreement rate and κ value. In addition, the results of medical record quality assessment and time required for review were analyzed.

RESULTS

There were a total of 4159 patients (55.5%) with at least 1 of the 41 screening criteria. In stage 1, the overall percent of agreement was 81.9% when all negatives from the 2 reviewers were included, and the κ value was 0.64 (95% confidence interval [CI], 0.61-0.66). In stage 2, 84.6% of cases were a perfect match, and 87.4% were a partial match. The κ values were 0.159 (95% CI, 0.12-0.20) and 0.389 (95% CI, 0.35-0.43), respectively. The mean quality assessment scores were 3.18 of 4 points in stage 1 and 3.05 of 4 points in stage 2. In stage 1, it took an average of 13.02 minutes to asses each patient file; in stage 2, it took an average of 5.06 minutes.

CONCLUSIONS

To increase the feasibility of medical record review for detecting adverse events, it is important not only to improve the reliability between reviewers but also to monitor the quality of medical records and the time required for review.

The Korea National Patient Safety Incidents Inquiry Survey: Characteristics of Adverse Events Identified Through Medical Records Review in Regional Public Hospitals

OBJECTIVES

In 2019, the Korean National Patient Safety Incidents Inquiry was conducted in the Republic of Korea to identify the national-level incidence of adverse events. This study determined the incidence and detailed the characteristics of adverse events at 15 regional public hospitals in the Republic of Korea.

METHODS

Medical records data of 500 randomly selected patients (discharged in 2016) were extracted from each of the 15 studied hospitals and reviewed in 3 stages. First, for each hospital, 2 nurses independently reviewed the medical records, using 41 screening criteria. Second, 2 physicians independently reviewed the records of those patients with at least 1 screening criterion from the first stage for adverse events occurrence and their characteristics. Third, a 9-member committee conducted a final review and compiled the final adverse event report.

RESULTS

Among 7500 patients, 4159 (55.5%) had at least 1 screening criterion; 745 (9.9%) experienced 901 adverse events (incidence, 12.0%). By type of institution, adverse event incidence varied widely from 1.2% to 45.6%. In 1032 adverse events, the majority (33.5%) were "patient care-related." By severity, the majority (638; 70.8%) were temporary, requiring intervention, whereas 38 (4.2%) resulted in death. The preventability score was high for "patient care-related" and "diagnosis-related" adverse events. Duration of hospitalization was extended for 463 (44.9%) adverse events, with "diagnosis-related" (30.8%) and "surgery/procedural-related" (30.1%) types extended by at least 21 days.

CONCLUSIONS

A review of medical records aids in identifying adverse events in medical institutions with varying characteristics, thus helping prioritize interventions to reduce their incidence.

The Trigger Tool Method for Routine Pharmacovigilance: A Retrospective Cohort Study of the Medical Records of Hospitalized Geriatric Patients

OBJECTIVE

The main objective was to assess the feasibility of the trigger tool method for the retrospective detection of adverse drug reactions (ADRs) in the Rennes University Hospital. The secondary objective was to describe the performance of the method in terms of positive predictive values (PPVs) and severity or preventability of ADRs.

METHODS

Using the Rennes University Hospital clinical data warehouse, pharmacovigilance experts performed a retrospective review of a random sample of 30 inpatient hospital medical records per month using the triggers "fall" and "delirium" to identify related ADRs among patients 65 years and older in 2018 in the geriatrics department. Using the Z test, we compared the proportion of medical records with a positive (identified) trigger related to an ADR, which were reviewed within 20 minutes using the reference of 50% reviewed within 20 minutes.

RESULTS

Among the 355 medical records reviewed, 222 had at least 1 trigger and 98 at least 1 related ADR. Among the 222 positive trigger medical records, 99.6% were reviewed in under 20 minutes (P < 0.001). The pharmacovigilance assessment took 3 months. The PPVs reached 53.9% (46.0%-61.7%) for falls and 21.0% (14.3%-27.5%) for delirium. Among the ADRs, 80% were serious and 53% were preventable.

CONCLUSIONS

Given the low PPV of the triggers used and the considerable need for technical and human resources, the trigger tool method cannot be used as a routine tool at the pharmacovigilance center. However, it could be implemented occasionally for specific purposes such as monitoring the impact of risk minimization measures to prevent ADRs.

Occurrence of No-Harm Incidents and Adverse Events in Hospitalized Patients with Ischemic Stroke or TIA: A Cohort Study Using Trigger Tool Methodology

Adverse events (AEs)—healthcare caused events leading to patient harm or even death—are common in healthcare. Although it is a frequently investigated topic, systematic knowledge on this phenomenon in stroke patients is limited. To determine cumulative incidence of no-harm incidents and AEs, including their severity and preventability, a cohort study using trigger tool methodology for retrospective record review was designed. The study was carried out in a stroke center at a university hospital in the German speaking part of Switzerland. Electronic records from 150 randomly selected patient admissions for transient ischemic attack (TIA) or ischemic stroke, with or without acute recanalization therapy, were used. In total, 170 events (108 AEs and 62 no-harm incidents) were identified, affecting 83 patients (55.3%; 95% CI 47 to 63.4), corresponding to an event rate of 113 events/100 admissions or 142 events/1000 patient days. The three most frequent AEs were ischemic strokes (n = 12, 7.1%), urinary tract infections (n = 11, 6.5%) and phlebitis (n = 10, 5.9%). The most frequent no-harm incidents were medication events (n = 37, 21.8%). Preventability ranged from 12.5% for allergic reactions to 100% for medication events and pressure ulcers. Most of the events found (142; 83.5%; 95% CI 76.9 to 88.6) occurred throughout the whole stroke care. The remaining 28 events (16.5%; 95% CI 11.4 to 23.1) were detected during stroke care but were related to care outside the stroke pathway. Trigger tool methodology allows detection of AEs and no-harm incidents, showing a frequent occurrence of both event types in stroke and TIA patients. Further investigations into events’ relationships with organizational systems and processes will be needed, first to achieve a better understanding of these events’ underlying mechanisms and risk factors, then to determine efforts needed to improve patient safety.

Development and Implementation of an e-Trigger Tool for Adverse Drug Events in a Swiss University Hospital

PURPOSE

The purpose of the study was to develop and implement an institution-specific trigger tool based on the Institute for Healthcare Improvement medication module trigger tool (IHI MMTT) in order to detect and monitor ADEs.

METHODS

We performed an investigator-driven, single-center study using retrospective and prospective patient data to develop ("development phase") and implement ("implementation phase") an efficient, institution-specific trigger tool based on the IHI MMTT. Complete medical data from 1008 patients hospitalized in 2018 were used in the development phase. ADEs were identified by chart review. The performance of two versions of the tool was assessed by comparing their sensitivities and specificities. Tool A employed only digitally extracted triggers ("e-trigger-tool") while Tool B employed an additional manually extracted trigger. The superior tool - taking efficiency into account - was applied prospectively to 19-22 randomly chosen charts per month for 26 months during the implementation phase.

RESULTS

In the development phase, 189 (19%) patients had ≥1 ADE (total 277 ADEs). The time needed to identify these ADEs was 15 minutes/chart. A total of 203 patients had ≥1 trigger (total 273 triggers - Tool B). The sensitivities and specificities of Tools A and B were 0.41 and 0.86, and 0.43 and 0.86, respectively. Tool A was more time-efficient than Tool B (4 vs 9 minutes/chart) and was therefore used in the implementation phase. During the 26-month implementation phase, 22 patients experienced trigger-identified ADEs and 529 did not. The median number of ADEs per 1000 patient days was 6 (range 0-13). Patients with at least one ADE had a mean hospital stay of 22.3 ± 19.7 days, compared to 8.0 ± 7.6 days for those without an ADE (p = 2.7×10-14).

CONCLUSION

We developed and implemented an e-trigger tool that was specific and moderately sensitive, gave consistent results and required minimal resources.

A Systematic Review of Methods for Medical Record Analysis to Detect Adverse Events in Hospitalized Patients

OBJECTIVE

In this systematic review, we evaluate 2 of the most used trigger tools according to the criteria of the World Health Organization for evaluating methods.

METHODS

We searched Embase, PubMed, and Cochrane databases for studies (2000-2017). Studies were included if medical record review (MRR) was performed with either the Global Trigger Tool or the Harvard Medical Practice Study in a hospital population. Quality assessment was performed in duplicate. Fifty studies were included, and results were reported for every criterion separately.

RESULTS

Medical record review reveals more adverse events (AEs) than any other method. However, at the same time, it detects different AEs. The costs of an AE were on average €4296. Considerable efforts have been made worldwide in health care to improve safety and to reduce errors. These have resulted in some positive effects. The literature showed that MRR is focused on several domains of quality of care and seems suitable for both small and large cohorts. Furthermore, we found a moderate to substantial agreement for the presence of a trigger and a moderate to good agreement for the presence of an AE.

CONCLUSIONS

Medical record review with a trigger tool is a reasonably well-researched method for the evaluation of the medical records for AEs. However, looking at the World Health Organization criteria, much research is still lacking or of moderate quality. Especially for the cost of detecting AEs, valuable information is missing. Moreover, knowledge of how MRR changes quality and safety of care should be evaluated.

Evolving Factors in Hospital Safety: A Systematic Review and Meta-Analysis of Hospital Adverse Events

OBJECTIVE

This study aimed to estimate the frequency of hospital adverse events (AEs) and explore the rate of AEs over time, and across and within hospital populations.

METHODS

Validated search terms were run in MEDLINE and EMBASE; gray literature and references of included studies were also searched. Studies of any design or language providing an estimate of AEs within the hospital were eligible. Studies were excluded if they only provided an estimate for a specific AE, a subgroup of hospital patients or children. Data were abstracted in duplicate using a standardized data abstraction form. Study quality was assessed using the Newcastle-Ottawa Scale. A random-effects meta-analysis estimated the occurrence of hospital AEs, and meta-regression explored the association between hospital AEs, and patient and hospital characteristics.

RESULTS

A total of 45,426 unique references were identified; 1,265 full-texts were reviewed and 94 studies representing 590 million admissions from 25 countries from 1961 to 2014 were included. The incidence of hospital AEs was 8.6 per 100 patient admissions (95% confidence interval [CI], 8.3 to 8.9; I2 = 100%, P < 0.001). Half of the AEs were preventable (52.6%), and a third resulted in moderate/significant harm (39.7%). The most evaluated AEs were surgical AEs, drug-related AEs, and nosocomial infections. The occurrence of AEs increased by year (95% CI, -0.05 to -0.04; P < 0.001) and patient age (95% CI = -0.15 to -0.14; P < 0.001), and varied by country income level and study characteristics. Patient sex, hospital type, hospital service, and geographical location were not associated with AEs.

CONCLUSIONS

Hospital AEs are common, and reported rates are increasing in the literature. Given the increase in AEs over time, hospitals should reinvest in improving hospital safety with a focus on interventions targeted toward the more than half of AEs that are preventable.

Adverse events in women giving birth in a labor ward: a retrospective record review study

Background

Childbirth could negatively affect the woman’s health through adverse events. To prevent adverse events and increase patient safety it is important to detect and learn from them. The aim of the study was to describe adverse events, including the preventability and severity of harm during planned vaginal births, in women giving birth in the labor ward.

Methods

The study had a descriptive design with a retrospective birth record review to assess the preventability of adverse events using the Swedish version of the Global Trigger Tool. The setting was a labor ward in Sweden with low-risk and risk childbirths. Descriptive statistics, Pearson’s Chi-square test and Student’s t-test were used.

Results

A total of 38 adverse events (12.2%) were identified in 311 reviewed birth records. Of these, 28 (73.7%) were assessed as preventable. Third- or fourth-degree lacerations and distended urinary bladder were most prevalent together with anesthesia-related adverse events. The majority of the adverse events were classified into the harm categories of ‘prolonged hospital care’ (63.2%) and ‘temporary harm’ (31.6%). No permanent harm were identified, but over two-thirds of the adverse events were assessed as preventable.

Conclusions

This first study using Global Trigger Tool in a labor ward in Sweden identified a higher incidence of adverse events than previous studies in obstetric care. No permanent patient harm was found, but over two-thirds of the adverse events were assessed as preventable. The results draw particular attention to 3^rd-or 4^th-degree lacerations, distended urinary bladder and anesthesia-related adverse events. The feedback on identified adverse events should be used for systematic quality improvement and clinical recommendations how to prevent adverse events must be implemented.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-07109-5.

Adverse Events Detection Through Global Trigger Tool Methodology: Results From a 5-Year Study in an Italian Hospital and Opportunities to Improve Interrater Reliability

OBJECTIVE

Global Trigger Tool (GTT) has been proposed as a low-cost method to detect adverse events (AEs). The validity of the methodology has been questioned because of moderate interrater agreement. Continuous training has been suggested as a means to improve consistency over time. We present the main findings of the implementation of the Italian version of the GTT and evaluate efforts to improve the interrater reliability over time.

METHODS

The Italian version of the GTT was developed and implemented at the San Bonifacio Hospital, a 270-bed secondary care acute hospital in Verona, Italy. Ten clinical records randomly selected every 2 weeks were reviewed from 2009 to 2014. Two-stage interrater reliability assessment between team members was conducted on 2 subsamples of 50 clinical records before and after the implementation of specific review rules and staff training.

RESULTS

Among 1320 medical records reviewed, a total of 366 AEs were found with at least 1 AE on 20.2% of all discharges, 27.7 AEs/100 admissions, and 30.6 AEs/1000 patient-days. Adverse events with harm score E and F were respectively 58.2% (n = 213) and 38.8% (n = 142). First round interrater reliability was comparable with other international studies. The interrater agreement improved significantly after intervention (κ interrater I = 0.52, κ interrater II = 0.80, P < 0.001).

CONCLUSIONS

Despite the improvements in the interrater consistency, overall results did not show any significant trend in AEs over time. Future studies may be directed to apply and adapt the GTT methodology to more specific settings to explore how to improve its sensitivity.

Trend Analysis of Patient Safety Incidents and Their Associated Factors in Korea Using National Patient Safety Report Data (2017~2019)

This study analyzed trends in patient safety incidents (PSIs) and the factors associated with the PSIs by analyzing 2017–2019 Patient Safety Report data in Korea. We extracted 2940 records in 2017, 5889 in 2018, and 7386 in 2019, from hospitals with more than 200 beds, and used all 16,215 cases for analysis. SPSS 25.0 was used for a multi-nominal logistic regression analysis. The PSI trend analysis, the standardized Jonckheere–Terpstra test was significant. On analyzing the probability of adverse events based on near misses, the significant variables were patient age, the season when PSIs occurred, incident reporter, hospital size, the location of PSIs, the type of PSIs, and medical department. Additionally, the factors that were likely to precipitate sentinel events based on near misses were patient sex, patient age, incident reporter, the type of PSIs, and medical department. To prevent sentinel events in PSIs, female and older patients are required to pay close attention. Moreover, it is necessary to establish a patient safety reporting system in which not only all medical personnel, but also patients, generally, can actively participate in patient safety activities and report voluntarily.

National and Institutional Trends in Adverse Events Over Time: A Systematic Review and Meta-analysis of Longitudinal Retrospective Patient Record Review Studies

OBJECTIVE

This study aimed to determine if the implementation of large-scale patient safety initiatives have been successful in reducing overall and preventable adverse event rates in hospital inpatients.

DESIGN

The design used in this study was systematic review and meta-analysis.

DATA RESOURCES

We followed our published protocol (PROSPERO [CRD42019140058]) and searched the following databases: PubMed, CINAHL, PsycINFO, Cochrane Library, and Embase from inception to February 2020. The reference lists of eligible studies were also searched.

ELIGIBILITY

All longitudinal retrospective record review studies that examined adverse event rates before and after the introduction of patient safety initiatives in hospital inpatients were included.

DATA EXTRACTION

Data extraction, quality, and risk of bias assessment were carried out by 2 independent reviewers. Information on study design, setting, demographics, interventions, and safety outcome measures was extracted.

RESULTS

A total of 3894 articles were screened, and 7 articles met the eligibility criteria for our systematic review with 5 of these providing sufficient information for inclusion in the meta-analysis. The degree of heterogeneity was high among studies. The meta-analysis demonstrated a minimal risk reduction in overall adverse event rates of 0.017 (95% confidence interval, 0.002-0.032) when the lower-quality studies were excluded, with one adverse event being prevented for every 59 hospital admissions.

CONCLUSIONS

These findings are significant when the large numbers of admissions to a hospital every year are considered. Given the low numbers of large-scale implementation studies, there is a need for more research on the effectiveness of patient safety initiatives to further assess the impact of such initiatives on adverse events.

Patient Safety Incidents Reported by the General Public in Korea: A Cross-Sectional Study

OBJECTIVES

Previous studies have demonstrated that the general public can report various patient safety incidents (PSIs) that are not identified by other methods. In this study, we investigated the characteristics of PSIs that the general public experience in Korea.

METHODS

In face-to-face surveys, participants were asked to report the frequency and type of PSIs, level of patient harm, and whether the PSIs were perceived as a medical error. We conducted logistic regression analysis to identify the sociodemographic factors of participants associated with their PSI experiences. Additionally, we analyzed relationships between the perception of PSIs as a medical error and both the type of PSIs and level of patient harm.

RESULTS

Among the 700 participants surveyed, 24 (3.4%) and 37 (5.3%) individuals reported that they or their family members experienced PSIs, respectively. Participants with at least a college degree were more likely to report PSI experiences than those with a lower educational level (odds ratio, 3.54; 95% confidence interval, 1.86-6.74). Whereas approximately half of participants (48.2%) involved in PSI experiences that caused no harm thought that there were medical errors in their PSIs, all participants (100%) who experienced PSIs with severe harm responded that medical errors occurred in their PSIs.

CONCLUSIONS

The general public can report their experiences with PSIs. Periodic surveys that target the general public will provide additional data that reflect the level of patient safety from the viewpoint of the general public.

Variation between hospitals and reviewers in detection of adverse events identified through medical record review in Korea

OBJECTIVES

This study utilized the method of medical record review to determine characteristics of adverse events that occurred in the inpatient units of hospitals in Korea as well as the variations in adverse events between institutions.

DESIGN

A two-stage retrospective medical record review was conducted. The first stage was a nurse review, where two nurses reviewed medical records of discharged patients to determine if screening criteria had been met. In the second stage, two physicians independently reviewed medical records of patients identified in the first stage, to determine whether an adverse event had occurred.

SETTING

Inpatient units of six hospitals.

PARTICIPANTS

Medical records of 2 596 patients randomly selected were reviewed in the first stage review.

INTERVENTION(S)

N/A.

MAIN OUTCOME MEASURE(S)

Adverse events.

RESULTS

A total of 277 patients (10.7%) were confirmed to have had one or more adverse event(s), and a total of 336 adverse events were identified. Physician reviewers agreed about whether an adverse event had occurred for 141 patients (5.4%). The incidence rate of adverse events was at least 1.3% and a maximum of 19.4% for each hospital. Most preventability scores were less than four points (non-preventable), and there were large variations between reviewers and institutions.

CONCLUSIONS

Given the level of variation in the identified adverse events, further studies that include more medical institutions in their investigations are needed, and a third-party committee should be involved to address the reliability issues regarding the occurrence and characteristics of the adverse events.

Adverse Drug Events and Contributing Factors Among Hospitalized Adult Patients at Jimma Medical Center, Southwest Ethiopia: A Prospective Observational Study

Background

Adverse drug events (ADEs) are common complications of clinical care resulting in significant morbidity, mortality, and high clinical expenditure. Population-level estimates of inpatient ADEs are limited in Ethiopia.

Objective

This study aimed to assess the incidence, contributing factors, severity, and preventability of ADEs among hospitalized adult patients at Jimma Medical Center, Ethiopia.

Methods

A prospective observational study design was conducted among hospitalized adult patients at tertiary hospital in Ethiopia. A structured data collection tool was prepared from relevant literatures for data collection. Data were analyzed using statistical software. Logistic regression was performed to identify factors contributing to ADE occurrence. P values < 0.05 were considered statistically significant.

Results

A total of 319 patients were included with follow-up period of 5667 person-days. About 50.5% were women. The mean (SD) age of patients was 43 (17.6) years. One hundred sixteen ADEs were identified with the incidence of 36.4 (95% CI, 30.1-43.6) per 100 admissions and 20.5 (95% CI, 16.9-24.6) per 1000 person-days. Antituberculosis agents (adjusted odds ratio [aOR] = 2.52; 95% CI, 1.06-5.98; P = 0.036), disease of the circulatory system (aOR = 2.67; 95% CI, 1.46-4.89; P = 0.001), disease of the digestive system (aOR = 2.84; 95% CI, 1.45-5.57; P = 0.002), being on medication during admission (aOR = 3.09; 95% CI, 1.77-5.41; P < 0.001), and hospital stay more than 2 weeks (aOR = 3.93; 95% CI, 1.39-11.12; P = 0.010) were independent predictors of ADE occurrence.

Conclusions

One in every 4 patients admitted to the hospital experienced ADEs during their hospital stay. Most ADEs were moderate in severity. About two-thirds of the ADEs identified were deemed probably or definitely preventable. Therefore, it is high time to reinforce large-scale efforts to redesign safer, higher quality health care systems to adequately tackle the problem.

A mixed methods study to effectively utilize trigger tools in the ICU

PURPOSE

This study aimed to create a trigger tool for our intensive care units (ICUs) to support our departmental quality improvement efforts.

METHODS

We compiled an initial list of triggers used in an ICU setting through literature review. We used a modified Delphi method to develop a unique set of triggers. An expert panel was selected for multidisciplinary and multi-site representation from four adult medical-surgical ICUs of a Canadian city. Respondents ranked triggers on a Likert scale based on its likelihood of being associated with adverse event (sensitivity to harm), and likelihood of being associated with suboptimal ICU processes (specificity for internal recommendations).

OUTCOMES

Our literature search yielded 10 articles and 59 triggers. Completion of the rating process resulted in 12 items that achieved consensus. Triggers included specific clinical, hospital-acquired infection, medication related, and procedural occurrences. One additional trigger (cardiopulmonary arrest) which consistently held high scores but did not achieve multidisciplinary consensus, was also included.

CONCLUSIONS

We used the modified Delphi process to derive consensus-selected triggers to identify ICU specific adverse events with opportunity for improvement in local care. This methodology can be adopted by other centers looking to introduce trigger tools in a manner selective to their practice needs.

Safety Climate and Organizational Communication Satisfaction Among Korean Perianesthesia Care Unit Nurses

PURPOSE

This study investigated organizational communication satisfaction and safety climate among perianesthesia care unit (PACU) nurses and factors affecting safety climate.

DESIGN

A cross-sectional study of 103 registered nurses currently working in PACUs in Korea.

METHODS

Organizational communication satisfaction was measured using the Communication Satisfaction Questionnaire, and safety climate was assessed using the Safety Attitudes Questionnaire-Korean version 2. Additional questions covered the demographics of the respondents and the characteristics of the hospital where they worked.

FINDINGS

Factors affecting teamwork climate included communication climate and horizontal informal communication. Safety climate was affected by media quality and organizational integration; job satisfaction by working in secondary hospitals, communication climate, and media quality; perception of management by working in public hospitals, media quality, and personal feedback; and working conditions by working in public hospitals, media quality, and personal feedback.

CONCLUSIONS

The results show that Korean PACU nurses experience poorer safety climate compared with other countries. One suggestion is to enhance nurses' satisfaction using organizational communication (eg, by developing effective communication media that satisfy users) and to promote communication at an organizational level so that individual health care professionals are aware of their organizations' vision and policies.

Teamwork, psychological safety, and patient safety competency among emergency nurses

INTRODUCTION

The patient safety competency of emergency nurses is critical because the emergency department is a complex and dynamic setting in which patient safety incidents are likely to occur owing to difficulties in controlling and predicting situations.

PURPOSE

This study aimed to identify factors that predict the patient safety competency of emergency nurses.

METHODS

A descriptive correlational study using cross-sectional survey methodology was conducted with a convenience sample of 200 emergency nurses. Teamwork, psychological safety, and patient safety competency were measured using a self-administered questionnaire. Data were analyzed using descriptive statistics, Pearson's correlation, and stepwise multiple regression.

RESULTS

Multiple regression analysis revealed that situation monitoring, reporting of patient safety adverse events, number of night shifts per month, and psychological safety were significant factors affecting patient safety competency, accounting for 27.1% of the variance.

CONCLUSIONS

A training program targeting emergency nurses with vulnerable factors is needed to improve their patient safety competency. As situation monitoring and psychological safety were found to be influential factors for patient safety competency, multi-level intervention is needed to improve nurses' situation monitoring ability and psychological safety.

[Influencing Factors and Consequences of Near Miss Experience in Nurses' Medication Error]

PURPOSE

This study aimed to predict the influencing factors and the consequences of near miss in nurses' medication error based upon Salazar & Primomo's ecological system theory.

METHODS

A convenience sample of 198 nurses was recruited for the cross-sectional survey design. Data were collected from July to September 2016. Using the collected data, the developed model was verified by structural equation modeling analysis using SPSS and AMOS program.

RESULTS

For the fitness of the hypothetical model, the results showed that χ² (χ²=258.50, p<.001) was not fit, but standardized χ² (χ²/df=2.35) was a good fit for this model. Additionally, absolute fit index RMR=.06, RMSEA=.08, GFI=.86, AGFI=.81 reached the recommended level, but the Incremental fit index TLI=.82, CFI=.85 was not enough to reach to the recommended level. With the path diagram of the hypothetical model, caution (β=-.29 p<.001), patient safety culture (β=-.20, p=.041), and work load (β=.18, p=.037) had a significant effect on the near miss experiences in nurses' medication error, while fatigue (β=-.06, p=.575) did not affect it. Moreover, the near miss experience had a significant effect on work productivity (β=-.25, p=.001).

CONCLUSION

These results have shown that to decrease the near miss experience by nurses and increase their work productivity in hospital environments would require both personal and organizational effort.

Prevalence, severity, and nature of preventable patient harm across medical care settings: systematic review and meta-analysis

OBJECTIVE

To systematically quantify the prevalence, severity, and nature of preventable patient harm across a range of medical settings globally.

DESIGN

Systematic review and meta-analysis.

DATA SOURCES

Medline, PubMed, PsycINFO, Cinahl and Embase, WHOLIS, Google Scholar, and SIGLE from January 2000 to January 2019. The reference lists of eligible studies and other relevant systematic reviews were also searched.

REVIEW METHODS

Observational studies reporting preventable patient harm in medical care. The core outcomes were the prevalence, severity, and types of preventable patient harm reported as percentages and their 95% confidence intervals. Data extraction and critical appraisal were undertaken by two reviewers working independently. Random effects meta-analysis was employed followed by univariable and multivariable meta regression. Heterogeneity was quantified by using the I2 statistic, and publication bias was evaluated.

RESULTS

Of the 7313 records identified, 70 studies involving 337 025 patients were included in the meta-analysis. The pooled prevalence for preventable patient harm was 6% (95% confidence interval 5% to 7%). A pooled proportion of 12% (9% to 15%) of preventable patient harm was severe or led to death. Incidents related to drugs (25%, 95% confidence interval 16% to 34%) and other treatments (24%, 21% to 30%) accounted for the largest proportion of preventable patient harm. Compared with general hospitals (where most evidence originated), preventable patient harm was more prevalent in advanced specialties (intensive care or surgery; regression coefficient b=0.07, 95% confidence interval 0.04 to 0.10).

CONCLUSIONS

Around one in 20 patients are exposed to preventable harm in medical care. Although a focus on preventable patient harm has been encouraged by the international patient safety policy agenda, there are limited quality improvement practices specifically targeting incidents of preventable patient harm rather than overall patient harm (preventable and non-preventable). Developing and implementing evidence-based mitigation strategies specifically targeting preventable patient harm could lead to major service quality improvements in medical care which could also be more cost effective.

Development of a trigger tool for the detection of adverse drug events in Chinese geriatric inpatients using the Delphi method

Background The global trigger tool is a method of retrospective medical record review that identifies possible harm in hospitalized patients using "triggers". Elderly patients with multiple co-morbid illnesses are especially vulnerable to adverse drug events (ADEs) that have high prevalence rates. Objective The purpose of this study was to develop an appropriate trigger tool to detect ADEs in Chinese geriatric inpatients by combining a literature review with the Delphi method. Setting Chinese geriatric inpatients. Methods Two steps were used to develop the trigger tool. First, we conducted a comprehensive literature review for existing ADE triggers (adult or elderly) to form the initial triggers for the Delphi process. Second, a group of clinical experts, including physicians, clinical pharmacists and nurses, was established to score candidate triggers for utility according to the usefulness and feasibility of implementing triggers in clinical practice. Main outcome measures The frequency of the full mark, arithmetic mean and coefficient of variation of each trigger. Results An initial set of 51 triggers was selected by literature review for evaluation. The group of experts was composed of 18 clinical experts: 13 physicians, 4 clinical pharmacists, and 1 nurse. Based on the two-phase Delphi process, 42 triggers in five categories (laboratory index, plasma concentration, antidotes, clinical symptoms and intervention) were retained. Conclusion The 42-trigger tool was developed to identify ADEs in Chinese geriatric inpatients. A pilot study that tests the list of triggers to identify ADEs in Chinese geriatric inpatients is the next step for establishing a specific trigger tool for Chinese geriatric inpatients.

Adverse events identified by the global trigger tool at a university hospital: A retrospective medical record review

OBJECTIVES

The purpose of this study was to describe the level, preventability and categories of adverse events (AEs) in Chinese geriatric patients identified by medical record review using the Global Trigger Tool. The applicability of the GTT was also assessed to explore possible modifications for trigger tools.

METHODS

The study was conducted at a 4300-bed tertiary teaching hospital. Twenty randomly-selected medical records for patients over 60 were reviewed every 2 weeks from January 1 2015 to December 31st, 2015. We studied 480 medical records in total. Two trained specialists reviewed the presence of AEs using 43 triggers, and a physician reviewed and validated the findings. The outcome measures included the number of AEs per 1000 patient days, AEs per 100 admissions, the percentage of entries with at least 1 AE and AE categorisation. Also, we carried out a descriptive analysis of the suspected factors of AEs, such as age, gender, length of stay, surgery.

RESULTS

A total of 610 AEs were detected in the 480 medical records reviewed, corresponding to 127 injuries per 100 admissions. The number of AEs per 1000 patient days was 22.43. AEs occurred at least once in 329 (68.54%) patients. The rate of care harms ranked highest of all AEs, followed by the rate of medication harms and surgical harms. Patients with a more extended hospital stay or surgery was more likely to experience AEs. However, there was a negative correlation between age and the rate of AEs.

CONCLUSION

The Global Trigger Tool was a useful method for detecting the characteristics of AEs in geriatric patients in a Chinese tertiary teaching hospital. To improve patients' safety, this tool should be incorporated into routine screening systems.

Factors Influencing the Patient Safety Management Activity of Nursing Students

Purpose: This purpose of this study was to identify the level of knowledge and attitude of patient safety and patient safety management activity (PSMA) and identify influencing factors of PSMA in nursing students. Methods: The participants were 210 fourth-year nursing students in C and G city. Data were collected with structured questionnaires from October 10 to November 10, 2017. Descriptive statistics, t-test, one way ANOVA, Pearson's correlation and multiple regression with SPSS 21.0 were used. Results: As a result, the level of knowledge of patient safety was 9.05, attitude of patient safety was 4.07, and PSMA was 4.22. The factors influencing PSMA were knowledge and attitude of patient safety. The regression model explained 77% of PSMA. Conclusion: Based on the results of this study, it is suggested that a systematic education program considering factors influencing the patient safety management activities of nursing students be developed.

Identifying Adverse Events Using International Classification of Diseases, Tenth Revision Y Codes in Korea: A Cross-sectional Study

Objectives

The use of administrative data is an affordable alternative to conducting a difficult large-scale medical-record review to estimate the scale of adverse events. We identified adverse events from 2002 to 2013 on the national level in Korea, using International Classification of Diseases, tenth revision (ICD-10) Y codes.

Methods

We used data from the National Health Insurance Service-National Sample Cohort (NHIS-NSC). We relied on medical treatment databases to extract information on ICD-10 Y codes from each participant in the NHIS-NSC. We classified adverse events in the ICD-10 Y codes into 6 types: those related to drugs, transfusions, and fluids; those related to vaccines and immunoglobulin; those related to surgery and procedures; those related to infections; those related to devices; and others.

Results

Over 12 years, a total of 20 817 adverse events were identified using ICD-10 Y codes, and the estimated total adverse event rate was 0.20%. Between 2002 and 2013, the total number of such events increased by 131.3%, from 1366 in 2002 to 3159 in 2013. The total rate increased by 103.9%, from 0.17% in 2002 to 0.35% in 2013. Events related to drugs, transfusions, and fluids were the most common (19 446, 93.4%), followed by those related to surgery and procedures (1209, 5.8%) and those related to vaccines and immunoglobulin (72, 0.3%).

Conclusions

Based on a comparison with the results of other studies, the total adverse event rate in this study was significantly underestimated. Improving coding practices for ICD-10 Y codes is necessary to precisely monitor the scale of adverse events in Korea.

An Exploration of Contributing Factors to Patient Safety

One in 3 patients is estimated to experience health care-related harm during hospitalization. This descriptive, cross-sectional study used the Safety Attitudes Questionnaire to measure interprofessional staff perceptions of safety and teamwork climate and a retrospective, modified Global Trigger Tool chart review methodology to measure unit-level patient outcomes. Safety climate and teamwork did not have a statistically significant relationship with the frequency of adverse events identified by the Global Trigger Tool. Researchers may consider the Global Trigger Tool for detecting unit-level adverse events.

Adverse drug events in Chinese pediatric inpatients and associated risk factors: a retrospective review using the Global Trigger Tool

Understanding the epidemiology and risk factors of adverse drug events (ADEs) in pediatric inpatient is essential if we are to prevent, reduce or ameliorate the harm experienced. The Global Trigger Tool (GTT) is a method of retrospective medical record review that measures harm in hospitalized children. We employed a three-stage retrospective chart review of random samples of 1800 pediatric inpatients discharged from January 2013 to December 2015. 31 kinds of pediatric-specific triggers were made based on the previous trigger tool studies developed for use in adult or pediatric. Positive predictive value (PPV) of individual triggers, as well as ADEs detection rates were calculated. Stepwise logistic regression was performed to investigate risk factors associated with ADEs. Of 1746 patients, detected in 221 patients (12.7%) with 247 ADEs. The PPV of the trigger tool was 13.3%. Of the 247 ADEs, 82.6% were identified as category E, 11.7% category F and 5.7% category H. The pediatric-focused trigger tool is a feasible and useful tool for detecting pediatric ADEs. Especially for patients who have had more drugs, more doses or more admissions which needs to be closely monitored as triggers to improve the safety.

The ability of triggers to retrospectively predict potentially preventable adverse events in a sample of deceased patients

Several trigger systems have been developed to screen medical records of hospitalized patients for adverse events (AEs). Because it's too labor-intensive to screen the records of all patients, usually a sample is screened. Our sample consists of patients who died during their stay because chances of finding preventable AEs in this subset are highest. Records were reviewed for fifteen triggers (n = 2182). When a trigger was present, the records were scrutinized by specialized medical doctors who searched for AEs. The positive predictive value (PPV) of the total trigger system and of the individual triggers was calculated. Additional analyses were performed to identify a possible optimization of the trigger system. In our sample, the trigger system had an overall PPV for AEs of 47%, 17% for potentially preventable AEs. More triggers present in a record increased the probability of detecting an AE. Adjustments to the trigger system slightly increased the positive predictive value but missed about 10% of the AEs detected with the original system. In our sample of deceased patients the trigger system has a PPV comparable to other samples. However still, an enormous amount of time and resources are spent on cases without AEs or with non-preventable AEs. Possibly, the performance could be further improved by combining triggers with clinical scores and laboratory results. This could be promising in reducing the costly and labor-intensive work of screening medical records.

The application of the Global Trigger Tool: a systematic review

Purpose

This study describes the use of, and modifications and additions made to, the Global Trigger Tool (GTT) since its first release in 2003, and summarizes its findings with respect to counting and characterizing adverse events (AEs).

Data sources

Peer-reviewed literature up to 31st December 2014.

Study selection

A systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement.

Data extraction

Two authors extracted and compiled the demographics, methodologies and results of the selected studies.

Results of data synthesis

Of the 48 studies meeting the eligibility criteria, 44 collected data from inpatient medical records and four from general practice records. Studies were undertaken in 16 countries. Over half did not follow the standard GTT protocol regarding the number of reviewers used. 'Acts of omission' were included in one quarter of studies. Incident reporting detected between 2% and 8% of AEs that were detected with the GTT. Rates of AEs varied in general inpatient studies between 7% and 40%. Infections, problems with surgical procedures and medication were the most common incident types.

Conclusion

The GTT is a flexible tool used in a range of settings with varied applications. Substantial differences in AE rates were evident across studies, most likely associated with methodological differences and disparate reviewer interpretations. AE rates should not be compared between institutions or studies. Recommendations include adding 'omission' AEs, using preventability scores for priority setting, and re-framing the GTT's purpose to understand and characterize AEs rather than just counting them.

An electronic trigger based on care escalation to identify preventable adverse events in hospitalised patients

Background

Methods to identify preventable adverse events typically have low yield and efficiency. We refined the methods of Institute of Healthcare Improvement’s Global Trigger Tool (GTT) application and leveraged electronic health record (EHR) data to improve detection of preventable adverse events, including diagnostic errors.

Methods

We queried the EHR data repository of a large health system to identify an ‘index hospitalization’ associated with care escalation (defined as transfer to the intensive care unit (ICU) or initiation of rapid response team (RRT) within 15 days of admission) between March 2010 and August 2015. To enrich the record review sample with unexpected events, we used EHR clinical data to modify the GTT algorithm and limited eligible patients to those at lower risk for care escalation based on younger age and presence of minimal comorbid conditions. We modified the GTT review methodology; two physicians independently reviewed eligible ‘e-trigger’ positive records to identify preventable diagnostic and care management events.

Results

Of 88 428 hospitalisations, 887 were associated with care escalation (712 ICU transfers and 175 RRTs), of which 92 were flagged as trigger-positive and reviewed. Preventable adverse events were detected in 41 cases, yielding a trigger positive predictive value of 44.6% (reviewer agreement 79.35%; Cohen’s kappa 0.573). We identified 7 (7.6%) diagnostic errors and 34 (37.0%) care management-related events: 24 (26.1%) adverse drug events, 4 (4.3%) patient falls, 4 (4.3%) procedure-related complications and 2 (2.2%) hospital-associated infections. In most events (73.1%), there was potential for temporary harm.

Conclusion

We developed an approach using an EHR data-based trigger and modified review process to efficiently identify hospitalised patients with preventable adverse events, including diagnostic errors. Such e-triggers can help overcome limitations of currently available methods to detect preventable harm in hospitalised patients.

Trigger Tool na Segurança do Doente: Uma Revisão Sistemática de Literatura

<b>Introdução:</b> A elevada incidência de eventos adversos (EA) é uma das situações preocupantes descritas na literatura sendo relacionada diretamente com o aumento dos custos com a prestação de cuidados de saúde e com o aumento do número de dias de internamento. A metodologia <i>Global Trigger Tool</i> (GTT) é relativamente nova mas tem-se mostrado promissora, em contextos internacionais, em ações de rastreio dos EA. <b>Objetivo:</b> Obter um corpo de evidência, reunindo um conjunto de informações acerca da utilização desta metodologia em contexto hospitalar. <b>Metodologia:</b> Trata-se de uma revisão sistemática da literatura, baseada em estudos primários relacionados com esta temática, publicados entre o ano 2009 e 2014. <b>Resultados:</b> O estudo incluiu 8 estudos primários e os resultados evidenciam dados relevantes acerca da utilidade da ferramenta GTT no âmbito hospitalar. <b>Conclusão:</b> A evidência científica mostra que a aplicação do método GTT, como estratégia de monitorização dos EA, é uma ferramenta viável, uma vez que permite acompanhar a implementação de mudanças orientadas para a redução da ocorrência dos EA.

Performance of trigger tools in identifying adverse drug events in emergency department patients: a validation study

AIMS

Trigger tools are retrospective surveillance methods that can be used to identify adverse drug events (ADEs), unintended and harmful effects of medications, in medical records. Trigger tools are used in quality improvement, public health surveillance and research activities. The objective of the study was to evaluate the performance of trigger tools in identifying ADEs.

METHODS

This study was a sub-study of a prospective cohort study which enrolled adults presenting to one tertiary care emergency department. Clinical pharmacists evaluated patients for ADEs at the point-of-care. Twelve months after the prospective study's completion, the patients' medical records were reviewed using eight different trigger tools. ADEs identified using each trigger tool were compared with events identified at the point-of-care. The primary outcome was the sensitivity of each trigger tool for ADEs.

RESULTS

Among 1151 patients, 152 (13.2%, 95% confidence intervals (CI) 11.4, 15.3%) were diagnosed with one or more ADEs at the point-of-care. The sensitivity of the trigger tools for detecting ADEs ranged from 2.6% (95% CI 0.7, 6.6%) to 15.8% (95% CI 10.6, 22.8%). Their specificity varied from 99.3% (95% CI 98.6, 99.7) to 100% (95% CI 99.6, 100%).

CONCLUSION

The trigger tools examined had poor sensitivity for identifying ADEs in emergency department patients, when applied manually and in retrospect. Reliance on these methods to detect ADEs for quality improvement, surveillance, and research activities is likely to underestimate their occurrence, and may lead to biased estimates.

Measurement of patient safety: a systematic review of the reliability and validity of adverse event detection with record review

OBJECTIVES

Record review is the most used method to quantify patient safety. We systematically reviewed the reliability and validity of adverse event detection with record review.

DESIGN

A systematic review of the literature.

METHODS

We searched PubMed, EMBASE, CINAHL, PsycINFO and the Cochrane Library and from their inception through February 2015. We included all studies that aimed to describe the reliability and/or validity of record review. Two reviewers conducted data extraction. We pooled κ values (κ) and analysed the differences in subgroups according to number of reviewers, reviewer experience and training level, adjusted for the prevalence of adverse events.

RESULTS

In 25 studies, the psychometric data of the Global Trigger Tool (GTT) and the Harvard Medical Practice Study (HMPS) were reported and 24 studies were included for statistical pooling. The inter-rater reliability of the GTT and HMPS showed a pooled κ of 0.65 and 0.55, respectively. The inter-rater agreement was statistically significantly higher when the group of reviewers within a study consisted of a maximum five reviewers. We found no studies reporting on the validity of the GTT and HMPS.

CONCLUSIONS

The reliability of record review is moderate to substantial and improved when a small group of reviewers carried out record review. The validity of the record review method has never been evaluated, while clinical data registries, autopsy or direct observations of patient care are potential reference methods that can be used to test concurrent validity.

Assessing Reliability of Medical Record Reviews for the Detection of Hospital Adverse Events

Objectives:

The purpose of this study was to assess the inter-rater reliability and intra-rater reliability of medical record review for the detection of hospital adverse events.

Methods:

We conducted two stages retrospective medical records review of a random sample of 96 patients from one acute-care general hospital. The first stage was an explicit patient record review by two nurses to detect the presence of 41 screening criteria (SC). The second stage was an implicit structured review by two physicians to identify the occurrence of adverse events from the positive cases on the SC. The inter-rater reliability of two nurses and that of two physicians were assessed. The intra-rater reliability was also evaluated by using test-retest method at approximately two weeks later.

Results:

In 84.2% of the patient medical records, the nurses agreed as to the necessity for the second stage review (kappa, 0.68; 95% confidence interval [CI], 0.54 to 0.83). In 93.0% of the patient medical records screened by nurses, the physicians agreed about the absence or presence of adverse events (kappa, 0.71; 95% CI, 0.44 to 0.97). When assessing intra-rater reliability, the kappa indices of two nurses were 0.54 (95% CI, 0.31 to 0.77) and 0.67 (95% CI, 0.47 to 0.87), whereas those of two physicians were 0.87 (95% CI, 0.62 to 1.00) and 0.37 (95% CI, -0.16 to 0.89).

Conclusions:

In this study, the medical record review for detecting adverse events showed intermediate to good level of inter-rater and intra-rater reliability. Well organized training program for reviewers and clearly defining SC are required to get more reliable results in the hospital adverse event study.

Clinical criteria to screen for inpatient diagnostic errors: a scoping review

Diagnostic errors are common and costly, but difficult to detect. "Trigger" tools have promise to facilitate detection, but have not been applied specifically for inpatient diagnostic error. We performed a scoping review to collate all individual "trigger" criteria that have been developed or validated that may indicate that an inpatient diagnostic error has occurred. We searched three databases and screened 8568 titles and abstracts to ultimately include 33 articles. We also developed a conceptual framework of diagnostic error outcomes using real clinical scenarios, and used it to categorize the extracted criteria. Of the multiple criteria we found related to inpatient diagnostic error and amenable to automated detection, the most common were death, transfer to a higher level of care, arrest or "code", and prolonged length of hospital stay. Several others, such as abrupt stoppage of multiple medications or change in procedure, may also be useful. Validation for general adverse event detection was done in 15 studies, but only one performed validation for diagnostic error specifically. Automated detection was used in only two studies. These criteria may be useful for developing diagnostic error detection tools.

Evaluating iatrogenic prescribing: development of an oncology-focused trigger tool

BACKGROUND

Drug-related iatrogenic effects are common in oncology because chemotherapy is toxic. The evaluation of the application of the guidelines may be a way to understand the occurrence of adverse drug-related event (ADE). There is no specific method for identifying ADEs and measuring harm to patients in oncology.

OBJECTIVE

Our objective was to develop and test an Oncology Trigger Tool (OTT) for ADEs and to describe ADE characteristics and incidence.

METHODS

A clinical advisory panel identified situations at high risk of ADE occurrence and built 22 triggers with, in each case, an analysis flowchart to confirm or refute occurrence. The OTT was used to review 288 random admissions (Oct. 2010-Sept. 2011) and measure ADE incidence and severity (CTCAE 4.03 - Common Terminology Criteria for Adverse Events). Tool feasibility (time required), inter-rater (IR) reproducibility and positive predictive value (PPV) were measured.

RESULTS

Overall, 884 triggers were detected and 122 ADEs, with 42.4 ADEs/100 admissions or 46.0 ADEs/1000 patient-days, and a 31.1% rate of severe ADEs. The most common ADEs were hyperglycaemia (14.5%), unplanned drug-related admission within 30 days (13.7%) and opiate-induced constipation (12.1%). Unplanned drug-related admission was the most serious (82.4% incidence of severe harm). Mean time for OTT implementation was 21.8 min; IR reproducibility was high (κ=0.965 (trigger); κ=0.935 (ADE); κ=0.853 (harm)); PPV 22-trigger version was 20.7%.

CONCLUSIONS

ADE analysis flowcharts coupled with standardised grading of harm considerably reduced IR variability, thus providing a robust oncology-focused trigger tool for use in ADE audits and hospital comparisons. The involvement of a clinical advisory panel in tool development should help drive changes for improving practice. Further research on the OTT is warranted.