CareTrack Kids-part 3. Adverse events in children's healthcare in Australia: study protocol for a retrospective medical record review

Predicting Adverse Drug Events in Chinese Pediatric Inpatients With the Associated Risk Factors: A Machine Learning Study

The aim of this study was to apply machine learning methods to deeply explore the risk factors associated with adverse drug events (ADEs) and predict the occurrence of ADEs in Chinese pediatric inpatients. Data of 1,746 patients aged between 28 days and 18 years (mean age = 3.84 years) were included in the study from January 1, 2013, to December 31, 2015, in the Children’s Hospital of Chongqing Medical University. There were 247 cases of ADE occurrence, of which the most common drugs inducing ADEs were antibacterials. Seven algorithms, including eXtreme Gradient Boosting (XGBoost), CatBoost, AdaBoost, LightGBM, Random Forest (RF), Gradient Boosting Decision Tree (GBDT), and TPOT, were used to select the important risk factors, and GBDT was chosen to establish the prediction model with the best predicting abilities (precision = 44%, recall = 25%, F1 = 31.88%). The GBDT model has better performance than Global Trigger Tools (GTTs) for ADE prediction (precision 44 vs. 13.3%). In addition, multiple risk factors were identified via GBDT, such as the number of trigger true (TT) (+), number of doses, BMI, number of drugs, number of admission, height, length of hospital stay, weight, age, and number of diagnoses. The influencing directions of the risk factors on ADEs were displayed through Shapley Additive exPlanations (SHAP). This study provides a novel method to accurately predict adverse drug events in Chinese pediatric inpatients with the associated risk factors, which may be applicable in clinical practice in the future.

Characterising the types of paediatric adverse events detected by the global trigger tool – CareTrack Kids

Introduction

A common method of learning about adverse events (AEs) is by reviewing medical records using the global trigger tool (GTT). However, these studies generally report rates of harm. The aim of this study is to characterise paediatric AEs detected by the GTT using descriptive and qualitative approaches.

Methods

Medical records of children aged 0–15 were reviewed for presence of harm using the GTT. Records from 2012–2013 were sampled from hospital inpatients, emergency departments, general practice and specialist paediatric practices in three Australian states. Nurses undertook a review of each record and if an AE was suspected a doctor performed a verification review of a summary created by the nurse. A qualitative content analysis was undertaken on the summary of verified AEs.

Results

A total of 232 AEs were detected from 6,689 records reviewed. Over four-fifths of the AEs (193/232, 83%) resulted in minor harm to the patient. Nearly half (112/232, 48%) related to medication/intravenous (IV) fluids. Of these, 83% (93/112) were adverse drug reactions. Problems with medical devices/equipment were the next most frequent with nearly two-thirds (32/51, 63%) of these related to intravenous devices. Problems associated with clinical processes/procedures comprise one in six AEs (38/232, 16%), of which diagnostic problems (12/38, 32%) and procedural complications (11/38, 29%) were the most frequent.

Conclusion

Adverse drug reactions and issues with IVs are frequently identified AEs reflecting their common use in paediatrics. The qualitative approach taken in this study allowed AE types to be characterised, which is a prerequisite for developing and prioritising improvements in practice.

Development of a trigger tool for the detection of adverse drug events in Chinese geriatric inpatients using the Delphi method

Background The global trigger tool is a method of retrospective medical record review that identifies possible harm in hospitalized patients using "triggers". Elderly patients with multiple co-morbid illnesses are especially vulnerable to adverse drug events (ADEs) that have high prevalence rates. Objective The purpose of this study was to develop an appropriate trigger tool to detect ADEs in Chinese geriatric inpatients by combining a literature review with the Delphi method. Setting Chinese geriatric inpatients. Methods Two steps were used to develop the trigger tool. First, we conducted a comprehensive literature review for existing ADE triggers (adult or elderly) to form the initial triggers for the Delphi process. Second, a group of clinical experts, including physicians, clinical pharmacists and nurses, was established to score candidate triggers for utility according to the usefulness and feasibility of implementing triggers in clinical practice. Main outcome measures The frequency of the full mark, arithmetic mean and coefficient of variation of each trigger. Results An initial set of 51 triggers was selected by literature review for evaluation. The group of experts was composed of 18 clinical experts: 13 physicians, 4 clinical pharmacists, and 1 nurse. Based on the two-phase Delphi process, 42 triggers in five categories (laboratory index, plasma concentration, antidotes, clinical symptoms and intervention) were retained. Conclusion The 42-trigger tool was developed to identify ADEs in Chinese geriatric inpatients. A pilot study that tests the list of triggers to identify ADEs in Chinese geriatric inpatients is the next step for establishing a specific trigger tool for Chinese geriatric inpatients.

Adverse drug events in Chinese pediatric inpatients and associated risk factors: a retrospective review using the Global Trigger Tool

Understanding the epidemiology and risk factors of adverse drug events (ADEs) in pediatric inpatient is essential if we are to prevent, reduce or ameliorate the harm experienced. The Global Trigger Tool (GTT) is a method of retrospective medical record review that measures harm in hospitalized children. We employed a three-stage retrospective chart review of random samples of 1800 pediatric inpatients discharged from January 2013 to December 2015. 31 kinds of pediatric-specific triggers were made based on the previous trigger tool studies developed for use in adult or pediatric. Positive predictive value (PPV) of individual triggers, as well as ADEs detection rates were calculated. Stepwise logistic regression was performed to investigate risk factors associated with ADEs. Of 1746 patients, detected in 221 patients (12.7%) with 247 ADEs. The PPV of the trigger tool was 13.3%. Of the 247 ADEs, 82.6% were identified as category E, 11.7% category F and 5.7% category H. The pediatric-focused trigger tool is a feasible and useful tool for detecting pediatric ADEs. Especially for patients who have had more drugs, more doses or more admissions which needs to be closely monitored as triggers to improve the safety.

Patient Safety Incidents Involving Sick Children in Primary Care in England and Wales: A Mixed Methods Analysis

BACKGROUND

The UK performs poorly relative to other economically developed countries on numerous indicators of care quality for children. The contribution of iatrogenic harm to these outcomes is unclear. As primary care is the first point of healthcare contact for most children, we sought to investigate the safety of care provided to children in this setting.

METHODS AND FINDINGS

We undertook a mixed methods investigation of reports of primary care patient safety incidents involving sick children from England and Wales' National Reporting and Learning System between 1 January 2005 and 1 December 2013. Two reviewers independently selected relevant incident reports meeting prespecified criteria, and then descriptively analyzed these reports to identify the most frequent and harmful incident types. This was followed by an in-depth thematic analysis of a purposive sample of reports to understand the reasons underpinning incidents. Key candidate areas for strengthening primary care provision and reducing the risks of systems failures were then identified through multidisciplinary discussions. Of 2,191 safety incidents identified from 2,178 reports, 30% (n = 658) were harmful, including 12 deaths and 41 cases of severe harm. The children involved in these incidents had respiratory conditions (n = 387; 18%), injuries (n = 289; 13%), nonspecific signs and symptoms, e.g., fever (n = 281; 13%), and gastrointestinal or genitourinary conditions (n = 268; 12%), among others. Priority areas for improvement included safer systems for medication provision in community pharmacies; triage processes to enable effective and timely assessment, diagnosis, and referral of acutely sick children attending out-of-hours services; and enhanced communication for robust safety netting between professionals and parents. The main limitations of this study result from underreporting of safety incidents and variable data quality. Our findings therefore require further exploration in longitudinal studies utilizing case review methods.

CONCLUSIONS

This study highlights opportunities to reduce iatrogenic harm and avoidable child deaths. Globally, healthcare systems with primary-care-led models of delivery must now examine their existing practices to determine the prevalence and burden of these priority safety issues, and utilize improvement methods to achieve sustainable improvements in care quality.

CareTrack Kids-part 1. Assessing the appropriateness of healthcare delivered to Australian children: study protocol for clinical indicator development

INTRODUCTION

Despite the widespread availability of clinical guidelines, considerable gaps remain between the care that is recommended (appropriate care) and the care provided. This protocol describes a research methodology to develop clinical indicators for appropriate care for common paediatric conditions.

METHODS AND ANALYSIS

We will identify conditions amenable to population-level appropriateness of care research and develop clinical indicators for each condition. Candidate conditions have been identified from published research; burden of disease, prevalence and frequency of presentation data; and quality of care priority lists. Clinical indicators will be developed through searches of national and international guidelines, and formatted with explicit criteria for inclusion, exclusion, time frame and setting. Experts will review the indicators using a wiki-based approach and modified Delphi process. A formative evaluation of the wiki process will be undertaken.

ETHICS AND DISSEMINATION

Human Research Ethics Committee approvals have been received from Sydney Children's Hospital Network, Children's Health Queensland Hospital and Health Service, and the Women's and Children's Health Network (South Australia). Applications are under review with Macquarie University and the Royal Australian College of General Practitioners. We will submit the results of the study to relevant journals and offer national and international presentations.

CareTrack Kids-part 2. Assessing the appropriateness of the healthcare delivered to Australian children: study protocol for a retrospective medical record review

INTRODUCTION

Australian and international clinical practice guidelines are available for common paediatric conditions. Yet there is evidence that there are substantial variations between the guidelines, recommendations (appropriate care) and the care delivered. This paper describes a study protocol to determine the appropriateness of the healthcare delivered to Australian children for 16 common paediatric conditions in acute and primary healthcare settings.

METHODS AND ANALYSIS

A random sample of 6000-8000 medical records representing a cross-section of the Australian paediatric population will be reviewed for appropriateness of care against a set of indicators within three Australian states (New South Wales, Queensland and South Australia) using multistage, stratified sampling. Medical records of children aged <16 years who presented with at least one of the study conditions during 2012 and 2013 will be reviewed.

ETHICS AND DISSEMINATION

Human Research Ethics Committee approvals have been received from the Sydney Children's Hospital Network, Children's Health Queensland Hospital and Health Service and Women's and Children's Hospital Network (South Australia). An application is under review for the Royal Australian College of General Practitioners. The authors will submit the results of the study to relevant journals and offer oral presentations to researchers, clinicians and policymakers at national and international conferences.