Development and validation of a Paediatric Early Warning Score for use in the emergency department: a multicentre study

Neurological Symptoms and Cause of Death Among Young Children in Low- and Middle-Income Countries

Importance

The emergence of acute neurological symptoms in children necessitates immediate intervention. Although low- and middle-income countries (LMICs) bear the highest burden of neurological diseases, there is a scarcity of diagnostic and therapeutic resources. Therefore, current understanding of the etiology of neurological emergencies in LMICs relies mainly on clinical diagnoses and verbal autopsies.

Objective

To characterize the association of premortem neurological symptoms and their management with postmortem-confirmed cause of death among children aged younger than 5 years in LMICs and to identify current gaps and improve strategies to enhance child survival.

Design, Setting, and Participants

This cross-sectional study was conducted between December 3, 2016, and July 22, 2022, at the 7 participating sites in the Child Health and Mortality Prevention Surveillance (CHAMPS) network (Bangladesh, Ethiopia, Kenya, Mali, Mozambique, Sierra Leone, and South Africa). Minimally invasive tissue sampling was performed at the CHAMPS sites with specimens from deceased children aged younger than 5 years. This study included deceased children who underwent a premortem neurological evaluation and had a postmortem-confirmed cause of death. Data analysis was performed between July 22, 2022, and January 15, 2023.

Main Outcomes and Measures

Descriptive analysis was performed using neurological evaluations from premortem clinical records and from postmortem determination of cause of death (based on histopathology, microbiological testing, clinical records, and verbal autopsies).

Results

Of the 2127 deaths of children codified during the study period, 1330 (62.5%) had neurological evaluations recorded and were included in this analysis. The 1330 children had a median age of 11 (IQR, 2-324) days; 745 (56.0%) were male and 727 (54.7%) presented with neurological symptoms during illness before death. The most common postmortem-confirmed neurological diagnoses related to death were hypoxic events (308 [23.2%]), meningoencephalitis (135 [10.2%]), and cerebral malaria (68 [5.1%]). There were 12 neonates with overlapping hypoxic events and meningoencephalitis, but there were no patients with overlapping meningoencephalitis and cerebral malaria. Neurological symptoms were similar among diagnoses, and no combination of symptoms was accurate in differentiating them without complementary tools. However, only 25 children (18.5%) with meningitis had a lumbar puncture performed before death. Nearly 90% of deaths (442 of 511 [86.5%]) with neurological diagnoses in the chain of events leading to death were considered preventable.

Conclusions and Relevance

In this cross-sectional study of children aged younger than 5 years, neurological symptoms were frequent before death. However, clinical phenotypes were insufficient to differentiate the most common underlying neurological diagnoses. The low rate of lumbar punctures performed was especially worrying, suggesting a challenge in quality of care of children presenting with neurological symptoms. Improved diagnostic management of neurological emergencies is necessary to ultimately reduce mortality in this vulnerable population.

Validation of the Emergency Department-Paediatric Early Warning Score (ED-PEWS) for use in low- and middle-income countries: A multicentre observational study

Early recognition of children at risk of serious illness is essential in preventing morbidity and mortality, particularly in low- and middle-income countries (LMICs). This study aimed to validate the Emergency Department-Paediatric Early Warning Score (ED-PEWS) for use in acute care settings in LMICs. This observational study is based on previously collected clinical data from consecutive children attending four diverse settings in LMICs. Inclusion criteria and study periods (2010-2021) varied. We simulated the ED-PEWS, consisting of patient age, consciousness, work of breathing, respiratory rate, oxygen saturation, heart rate, and capillary refill time, based on the first available parameters. Discrimination was assessed by the area under the curve (AUC), sensitivity and specificity (previously defined cut-offs < 6 and ≥ 15). The outcome measure was for each setting a composite marker of high urgency. 41,917 visits from Gambia rural, 501 visits from Gambia urban, 2,608 visits from Suriname, and 1,682 visits from Tanzania were included. The proportion of high urgency was variable (range 4.6% to 24.9%). Performance ranged from AUC 0.80 (95%CI 0.70-0.89) in Gambia urban to 0.62 (95%CI 0.55-0.67) in Tanzania. The low-urgency cut-off showed a high sensitivity in all settings ranging from 0.83 (95%CI 0.81-0.84) to 1.00 (95%CI 0.97-1.00). The high-urgency cut-off showed a specificity ranging from 0.71 (95%CI 0.66-0.75) to 0.97 (95%CI 0.97-0.97). The ED-PEWS has a moderate to good performance for the recognition of high urgency children in these LMIC settings. The performance appears to have potential in improving the identification of high urgency children in LMICs.

Factors predictive of hospital admission for children via emergency departments in Australia and Sweden: an observational cross-sectional study

BACKGROUND

Identifying factors predictive of hospital admission can be useful to prospectively inform bed management and patient flow strategies and decrease emergency department (ED) crowding. It is largely unknown if admission rate or factors predictive of admission vary based on the population to which the ED served (i.e., children only, or both adults and children). This study aimed to describe the profile and identify factors predictive of hospital admission for children who presented to four EDs in Australia and one ED in Sweden.

METHODS

A multi-site observational cross-sectional study using routinely collected data pertaining to ED presentations made by children < 18 years of age between July 1, 2011 and October 31, 2012. Univariate and multivariate analysis were undertaken to determine factors predictive of hospital admission.

RESULTS

Of the 151,647 ED presentations made during the study period, 22% resulted in hospital admission. Admission rate varied by site; the children's EDs in Australia had higher admission rates (South Australia: 26%, Queensland: 23%) than the mixed (adult and children's) EDs (South Australia: 13%, Queensland: 17%, Sweden: 18%). Factors most predictive of hospital admission for children, after controlling for triage category, included hospital type (children's only) adjusted odds ratio (aOR):2.3 (95%CI: 2.2-2.4), arrival by ambulance aOR:2.8 (95%CI: 2.7-2.9), referral from primary health aOR:1.5 (95%CI: 1.4-1.6) and presentation with a respiratory or gastrointestinal condition (aOR:2.6, 95%CI: 2.5-2.8 and aOR:1.5, 95%CI: 1.4-1.6, respectively). Predictors were similar when each site was considered separately.

CONCLUSIONS

Although the characteristics of children varied by site, factors predictive of hospital admission were mostly similar. The awareness of these factors predicting the need for hospital admission can support the development of clinical pathways.

Association between mortality and critical events within 48 hours of transfer to the pediatric intensive care unit

Introduction

Critical deterioration in hospitalized children, defined as ward to pediatric intensive care unit (PICU) transfer followed by mechanical ventilation (MV) or vasoactive infusion (VI) within 12 h, has been used as a primary metric to evaluate the effectiveness of clinical interventions or quality improvement initiatives. We explore the association between critical events (CEs), i.e., MV or VI events, within the first 48 h of PICU transfer from the ward or emergency department (ED) and in-hospital mortality.

Methods

We conducted a retrospective study of a cohort of PICU transfers from the ward or the ED at two tertiary-care academic hospitals. We determined the association between mortality and occurrence of CEs within 48 h of PICU transfer after adjusting for age, gender, hospital, and prior comorbidities.

Results

Experiencing a CE within 48 h of PICU transfer was associated with an increased risk of mortality [OR 12.40 (95% CI: 8.12-19.23, P < 0.05)]. The increased risk of mortality was highest in the first 12 h [OR 11.32 (95% CI: 7.51-17.15, P < 0.05)] but persisted in the 12-48 h time interval [OR 2.84 (95% CI: 1.40-5.22, P < 0.05)]. Varying levels of risk were observed when considering ED or ward transfers only, when considering different age groups, and when considering individual 12-h time intervals.

Discussion

We demonstrate that occurrence of a CE within 48 h of PICU transfer was associated with mortality after adjusting for confounders. Studies focusing on the impact of quality improvement efforts may benefit from using CEs within 48 h of PICU transfer as an additional evaluation metric, provided these events could have been influenced by the initiative.

Characteristics and Admission Preferences of Pediatric Emergency Patients and Their Waiting Time Prediction Using Electronic Medical Record Data: Retrospective Comparative Analysis

BACKGROUND

The growing number of patients visiting pediatric emergency departments could have a detrimental impact on the care provided to children who are triaged as needing urgent attention. Therefore, it has become essential to continuously monitor and analyze the admissions and waiting times of pediatric emergency patients. Despite the significant challenge posed by the shortage of pediatric medical resources in China's health care system, there have been few large-scale studies conducted to analyze visits to the pediatric emergency room.

OBJECTIVE

This study seeks to examine the characteristics and admission patterns of patients in the pediatric emergency department using electronic medical record (EMR) data. Additionally, it aims to develop and assess machine learning models for predicting waiting times for pediatric emergency department visits.

METHODS

This retrospective analysis involved patients who were admitted to the emergency department of Children's Hospital Capital Institute of Pediatrics from January 1, 2021, to December 31, 2021. Clinical data from these admissions were extracted from the electronic medical records, encompassing various variables of interest such as patient demographics, clinical diagnoses, and time stamps of clinical visits. These indicators were collected and compared. Furthermore, we developed and evaluated several computational models for predicting waiting times.

RESULTS

In total, 183,024 eligible admissions from 127,368 pediatric patients were included. During the 12-month study period, pediatric emergency department visits were most frequent among children aged less than 5 years, accounting for 71.26% (130,423/183,024) of the total visits. Additionally, there was a higher proportion of male patients (104,147/183,024, 56.90%) compared with female patients (78,877/183,024, 43.10%). Fever (50,715/183,024, 27.71%), respiratory infection (43,269/183,024, 23.64%), celialgia (9560/183,024, 5.22%), and emesis (6898/183,024, 3.77%) were the leading causes of pediatric emergency room visits. The average daily number of admissions was 501.44, and 18.76% (34,339/183,204) of pediatric emergency department visits resulted in discharge without a prescription or further tests. The median waiting time from registration to seeing a doctor was 27.53 minutes. Prolonged waiting times were observed from April to July, coinciding with an increased number of arrivals, primarily for respiratory diseases. In terms of waiting time prediction, machine learning models, specifically random forest, LightGBM, and XGBoost, outperformed regression methods. On average, these models reduced the root-mean-square error by approximately 17.73% (8.951/50.481) and increased the R2 by approximately 29.33% (0.154/0.525). The SHAP method analysis highlighted that the features "wait.green" and "department" had the most significant influence on waiting times.

CONCLUSIONS

This study offers a contemporary exploration of pediatric emergency room visits, revealing significant variations in admission rates across different periods and uncovering certain admission patterns. The machine learning models, particularly ensemble methods, delivered more dependable waiting time predictions. Patient volume awaiting consultation or treatment and the triage status emerged as crucial factors contributing to prolonged waiting times. Therefore, strategies such as patient diversion to alleviate congestion in emergency departments and optimizing triage systems to reduce average waiting times remain effective approaches to enhance the quality of pediatric health care services in China.

Are children with prolonged fever at a higher risk for serious illness? A prospective observational study

OBJECTIVES

To describe the characteristics and clinical outcomes of children with fever ≥5 days presenting to emergency departments (EDs).

DESIGN

Prospective observational study.

SETTING

12 European EDs.

PATIENTS

Consecutive febrile children <18 years between January 2017 and April 2018.

INTERVENTIONS

Children with fever ≥5 days and their risks for serious bacterial infection (SBI) were compared with children with fever <5 days, including diagnostic accuracy of non-specific symptoms, warning signs and C-reactive protein (CRP; mg/L).

MAIN OUTCOME MEASURES

SBI and other non-infectious serious illness.

RESULTS

3778/35 705 (10.6%) of febrile children had fever ≥5 days. Incidence of SBI in children with fever ≥5 days was higher than in those with fever <5 days (8.4% vs 5.7%). Triage urgency, life-saving interventions and intensive care admissions were similar for fever ≥5 days and <5 days. Several warning signs had good rule in value for SBI with specificities >0.90, but were observed infrequently (range: 0.4%-17%). Absence of warning signs was not sufficiently reliable to rule out SBI (sensitivity 0.92 (95% CI 0.87-0.95), negative likelihood ratio (LR) 0.34 (0.22-0.54)). CRP <20 mg/L was useful for ruling out SBI (negative LR 0.16 (0.11-0.24)). There were 66 cases (1.7%) of non-infectious serious illnesses, including 21 cases of Kawasaki disease (0.6%), 28 inflammatory conditions (0.7%) and 4 malignancies.

CONCLUSION

Children with prolonged fever have a higher risk of SBI, warranting a careful clinical assessment and diagnostic workup. Warning signs of SBI occurred infrequently but, if present, increased the likelihood of SBI. Although rare, clinicians should consider important non-infectious causes of prolonged fever.

European study confirms the combination of fever and petechial rash as an important warning sign for childhood sepsis and meningitis

AIM

This study investigated febrile children with petechial rashes who presented to European emergency departments (EDs) and investigated the role that mechanical causes played in diagnoses.

METHODS

Consecutive patients with fever presenting to EDs in 11 European emergency departments in 2017-2018 were enrolled. The cause and focus of infection were identified and a detailed analysis was performed on children with petechial rashes. The results are presented as odds ratios (OR) with 95% confidence intervals (CI).

RESULTS

We found that 453/34010 (1.3%) febrile children had petechial rashes. The focus of the infection included sepsis (10/453, 2.2%) and meningitis (14/453, 3.1%). Children with a petechial rash were more likely than other febrile children to have sepsis or meningitis (OR 8.5, 95% CI 5.3-13.1) and bacterial infections (OR 1.4, 95% CI 1.0-1.8) as well as need for immediate life-saving interventions (OR 6.6, 95% CI 4.4-9.5) and intensive care unit admissions (OR 6.5, 95% CI 3.0-12.5).

CONCLUSION

The combination of fever and petechial rash is still an important warning sign for childhood sepsis and meningitis. Ruling out coughing and/or vomiting was insufficient to safely identify low-risk patients.

Parental Ability to Assess Pediatric Vital Signs

OBJECTIVE

To evaluate parents' ability to accurately assess their child's heart and respiratory rates (RRs) in the context of potential utility for telehealth visits.

STUDY DESIGN

In this controlled study of 203 child-parent pairs, parents measured their child's heart rate (HR) using 4 methods: palpation, auscultation, and 2 photoplethysmographic smartphone applications. Parents measured RR by inspecting the child and tapping the smartphone application. The gold standards were electrocardiogram for the HR and the child's breaths measured by a health care professional for 60 seconds for the RR. We plotted the measurements using a Bland-Altman plot with 95% limits of agreement.

RESULTS

Parents underestimated HR by palpation with a calculated bias of -18 beats per minute (bpm) (SD, 19), with limits of agreement ranging from -56 to 19 bpm. Parents overestimated and underestimated HR by auscultation with limits of agreement ranging from -53 to 46 bpm. Smartphone applications did not improve the accuracy of measurements. The accuracy of parental RR measurements was low. For young children, bias was -0.8 breaths per minute (brpm) (SD, 9.8) with limits of agreement from -20 to 19 brpm, and for older children, bias was 0.9 brpm (SD 7.4) with limits of agreement from 6 to 15 brpm. The sensitivity of parental subjective opinion to recognize accelerated RR was 37% (95% CI, 25%-51%).

CONCLUSION

Parents were not able to assess their child's RR or HR accurately. Digital remote assessment of children should not rely on parental measurements of vital signs.

Do paediatric early warning systems reduce mortality and critical deterioration events among children? A systematic review and meta-analysis

Aim

We conducted a systematic review and meta-analysis to answer the question: Does the implementation of Paediatric Early Warning Systems (PEWS) in the hospital setting reduce mortality, cardiopulmonary arrests, unplanned codes and critical deterioration events among children, as compared to usual care without PEWS?

Methods

We conducted a comprehensive search using Medline, EMBASE, Cochrane Central Register of Controlled Trials, Cumulative Index to Nursing and Allied Health Literature and Web of Science. We included studies published between January 2006 and April 2022 on children <18 years old performed in inpatient units and emergency departments, and compared patient populations with PEWS to those without PEWS. We excluded studies without a comparator, case control studies, systematic reviews, and studies published in non-English languages. We employed a random effects meta-analysis and synthesised the risk and rate ratios from individual studies. We used the Scottish Intercollegiate Guidelines Network (SIGN) to appraise the risk of bias.

Results

Among 911 articles screened, 15 were included for descriptive analysis. Fourteen of the 15 studies were pre- versus post-implementation studies and one was a multi-centre cluster randomised controlled trial (RCT). Among 10 studies (580,604 hospital admissions) analysed for mortality, we found an increased risk (pooled RR 1.18, 95% CI 1.01–1.38, p = 0.036) in the group without PEWS compared to the group with PEWS. The sensitivity analysis performed without the RCT (436,065 hospital admissions) showed a non-significant relationship (pooled RR 1.17, 95% CI 0.98–1.40, p = 0.087). Among four studies (168,544 hospital admissions) analysed for unplanned code events, there was an increased risk in the group without PEWS (pooled RR 1.73, 95%CI 1.01–2.96, p = 0.046) There were no differences in the rate of cardiopulmonary arrests or critical deterioration events between groups. Our findings were limited by potential confounders and imprecision among included studies.

Conclusions

Healthcare systems that implemented PEWS were associated with reduced mortality and code rates. We recognise that these gains vary depending on resource availability and efferent response systems.

PROSPERO registration: CRD42021269579.

Practice variation across five European paediatric emergency departments: a prospective observational study

OBJECTIVES

To compare paediatric healthcare practice variation among five European emergency departments (EDs) by analysing variability in decisions about diagnostic testing, treatment and admission.

DESIGN AND POPULATION

Consecutive paediatric visits in five European EDs in four countries (Austria, Netherlands, Portugal, UK) were prospectively collected during a study period of 9-36 months (2012-2015).

PRIMARY OUTCOME MEASURES

Practice variation was studied for the following management measures: lab testing, imaging, administration of intravenous medication and patient disposition after assessment at the ED.

ANALYSIS

Multivariable logistic regression was used to adjust for general patient characteristics and markers of disease severity. To assess whether ED was significantly associated with management, the goodness-of-fit of regression models based on all variables with and without ED as explanatory variable was compared. Management measures were analysed across different categories of presenting complaints.

RESULTS

Data from 111 922 children were included, with a median age of 4 years (IQR 1.7-9.4). There were large differences in frequencies of Manchester Triage System (MTS) urgency and selected MTS presentational flow charts. ED was a significant covariate for management measures. The variability in management among EDs was fairly consistent across different presenting complaints after adjustment for confounders. Adjusted OR (aOR) for laboratory testing were consistently higher in one hospital while aOR for imaging were consistently higher in another hospital. Iv administration of medication and fluids and admission was significantly more likely in two other hospitals, compared with others, for most presenting complaints.

CONCLUSIONS

Distinctive hospital-specific patterns in variability of management could be observed in these five paediatric EDs, which were consistent across different groups of clinical presentations. This could indicate fundamental differences in paediatric healthcare practice, influenced by differences in factors such as organisation of primary care, diagnostic facilities and available beds, professional culture and patient expectations.

Improving triage for children with comorbidity using the ED-PEWS: an observational study

OBJECTIVE

To assess the value of the Emergency Department-Pediatric Early Warning Score (ED-PEWS) for triage of children with comorbidity.

DESIGN

Secondary analysis of a prospective cohort.

SETTING AND PATIENTS

53 829 consecutive ED visits of children <16 years in three European hospitals (Netherlands, UK and Austria) participating in the TrIAGE (Triage Improvements Across General Emergency departments) project in different periods (2012-2015).

INTERVENTION

ED-PEWS, a score consisting of age and six physiological parameters.

MAIN OUTCOME MEASURE

A three-category reference standard as proxy for true patient urgency. We assessed discrimination and calibration of the ED-PEWS for children with comorbidity (complex and non-complex) and without comorbidity. In addition, we evaluated the value of adding the ED-PEWS to the routinely used Manchester Triage System (MTS).

RESULTS

5053 (9%) children had underlying non-complex morbidity and 5537 (10%) had complex comorbidity. The c-statistic for identification of high-urgency patients was 0.86 (95% prediction interval 0.84-0.88) for children without comorbidity, 0.87 (0.82-0.92) for non-complex and 0.86 (0.84-0.88) for complex comorbidity. For high and intermediate urgency, the c-statistic was 0.63 (0.62-0.63), 0.63 (0.61-0.65) and 0.63 (0.55-0.73) respectively. Sensitivity was slightly higher for children with comorbidity (0.73-0.75 vs 0.70) at the cost of a lower specificity (0.86-0.87 vs 0.92). Calibration was largely similar. Adding the ED-PEWS to the MTS for children with comorbidity improved performance, except in the setting with few high-urgency patients.

CONCLUSIONS

The ED-PEWS has a similar performance in children with and without comorbidity. Adding the ED-PEWS to the MTS for children with comorbidity improves triage, except in the setting with few high-urgency patients.

Characteristics of pediatric emergency department frequent visitors and their risk of a return visit: A large observational study using electronic health record data

Background

Among pediatric emergency department (ED) visits, a subgroup of children repeatedly visits the ED, making them frequent visitors (FVs). The aim of this study is to get insight into the group of pediatric ED FVs and to determine risk factors associated with a revisit.

Methods and findings

Data of all children aged 0–18 years visiting the ED of a university hospital in the Netherlands between 2017 and 2020 were included in this observational study based on routine data extraction. Children with 4 or more ED visits within 365 days were classified as FVs. Descriptive analysis of the study cohort at patient- and visit-level were performed. Risk factors for a recurrent ED visit were determined using a Prentice Williams and Peterson gap time cox-based model. Our study population of 10,209 children with 16,397 ED visits contained 500 FVs (4.9%) accounting for 3,481 visits (21.2%). At patient-level, FVs were younger and more often suffered from chronic diseases (CDs). At visit-level, frequent visits were more often initiated by self-referral and were more often related to medical problems (compared to trauma’s). Overall, FVs presented at the ED more often because of an infection (41.3%) compared to non-FVs (27.4%), either associated or not with the body system affected by the CD. We identified the presence of a comorbidity (non-complex CD HR 1.66; 1.52–1.81 and complex CD HR 2.00; 1.84–2.16) as determinants with the highest hazard for a return visit.

Conclusion

Pediatric ED FVs are a small group of children but account for a large amount of the total ED visits. FVs are younger patients, suffering from (complex) comorbidities and present more often with infectious conditions compared to non-FVs. Healthcare pathways, including safety-netting strategies for acute manifestations from their comorbidity, or for infectious conditions in general may contribute to support parents and redirect some patients from the ED.

Febrile children with comorbidities at the emergency department - a multicentre observational study

We aimed to describe characteristics and management of children with comorbidities attending European emergency departments (EDs) with fever. MOFICHE (Management and Outcome of Fever in children in Europe) is a prospective multicentre study (12 European EDs, 8 countries). Febrile children with comorbidities were compared to those without in terms of patient characteristics, markers of disease severity, management, and diagnosis. Comorbidity was defined as a chronic underlying condition that is expected to last > 1 year. We performed multivariable logistic regression analysis, displaying adjusted odds ratios (aOR), adjusting for patient characteristics. We included 38,110 patients, of whom 5906 (16%) had comorbidities. Most common comorbidities were pulmonary, neurologic, or prematurity. Patients with comorbidities more often were ill appearing (20 versus 16%, p < 0.001), had an ED-Paediatric Early Warning Score of > 15 (22 versus 12%, p < 0.001), or a C-reactive protein > 60 mg/l (aOR 1.4 (95%CI 1.3-1.6)). They more often required life-saving interventions (aOR 2.7, 95% CI 2.2-3.3), were treated with intravenous antibiotics (aOR 2.3, 95%CI 2.1-2.5), and were admitted to the ward (aOR 2.2, 95%CI 2.1-2.4) or paediatric intensive care unit (PICU) (aOR 5.5, 95% CI 3.8-7.9). They were more often diagnosed with serious bacterial infections (aOR 1.8, 95%CI 1.7-2.0), including sepsis/meningitis (aOR 4.6, 95%CI 3.2-6.7). Children most at risk for sepsis/meningitis were children with malignancy/immunodeficiency (aOR 14.5, 8.5-24.8), while children with psychomotor delay/neurological disease were most at risk for life-saving interventions (aOR 5.3, 4.1-6.9) or PICU admission (aOR 9.7, 6.1-15.5).

CONCLUSIONS

Our data show how children with comorbidities are a population at risk, as they more often are diagnosed with bacterial infections and more often require PICU admission and life-saving interventions.

WHAT IS KNOWN

• While children with comorbidity constitute a large part of ED frequent flyers, they are often excluded from studies.

WHAT IS NEW

• Children with comorbidities in general are more ill upon presentation than children without comorbidities. • Children with comorbidities form a heterogeneous group; specific subgroups have an increased risk for invasive bacterial infections, while others have an increased risk of invasive interventions such as PICU admission, regardless of the cause of the fever.

A clinical prediction model to identify children at risk for revisits with serious illness to the emergency department: A prospective multicentre observational study

BACKGROUND

To develop a clinical prediction model to identify children at risk for revisits with serious illness to the emergency department.

METHODS AND FINDINGS

A secondary analysis of a prospective multicentre observational study in five European EDs (the TRIAGE study), including consecutive children aged <16 years who were discharged following their initial ED visit ('index' visit), in 2012-2015. Standardised data on patient characteristics, Manchester Triage System urgency classification, vital signs, clinical interventions and procedures were collected. The outcome measure was serious illness defined as hospital admission or PICU admission or death in ED after an unplanned revisit within 7 days of the index visit. Prediction models were developed using multivariable logistic regression using characteristics of the index visit to predict the likelihood of a revisit with a serious illness. The clinical model included day and time of presentation, season, age, gender, presenting problem, triage urgency, and vital signs. An extended model added laboratory investigations, imaging, and intravenous medications. Cross validation between the five sites was performed, and discrimination and calibration were assessed using random effects models. A digital calculator was constructed for clinical implementation. 7,891 children out of 98,561 children had a revisit to the ED (8.0%), of whom 1,026 children (1.0%) returned to the ED with a serious illness. Rates of revisits with serious illness varied between the hospitals (range 0.7-2.2%). The clinical model had a summary Area under the operating curve (AUC) of 0.70 (95% CI 0.65-0.74) and summary calibration slope of 0.83 (95% CI 0.67-0.99). 4,433 children (5%) had a risk of > = 3%, which was useful for ruling in a revisit with serious illness, with positive likelihood ratio 4.41 (95% CI 3.87-5.01) and specificity 0.96 (95% CI 0.95-0.96). 37,546 (39%) had a risk <0.5%, which was useful for ruling out a revisit with serious illness (negative likelihood ratio 0.30 (95% CI 0.25-0.35), sensitivity 0.88 (95% CI 0.86-0.90)). The extended model had an improved summary AUC of 0.71 (95% CI 0.68-0.75) and summary calibration slope of 0.84 (95% CI 0.71-0.97). As study limitations, variables on ethnicity and social deprivation could not be included, and only return visits to the original hospital and not to those of surrounding hospitals were recorded.

CONCLUSION

We developed a prediction model and a digital calculator which can aid physicians identifying those children at highest and lowest risks for developing a serious illness after initial discharge from the ED, allowing for more targeted safety netting advice and follow-up.

Improving the prioritization of children at the emergency department: Updating the Manchester Triage System using vital signs

Background

Vital signs are used in emergency care settings in the first assessment of children to identify those that need immediate attention. We aimed to develop and validate vital sign based Manchester Triage System (MTS) discriminators to improve triage of children at the emergency department.

Methods and findings

The TrIAGE project is a prospective observational study based on electronic health record data from five European EDs (Netherlands (n = 2), United Kingdom, Austria, and Portugal). In the current study, we included 117,438 consecutive children <16 years presenting to the ED during the study period (2012–2015). We derived new discriminators based on heart rate, respiratory rate, and/or capillary refill time for specific subgroups of MTS flowcharts. Moreover, we determined the optimal cut-off value for each vital sign. The main outcome measure was a previously developed 3-category reference standard (high, intermediate, low urgency) for the required urgency of care, based on mortality at the ED, immediate lifesaving interventions, disposition and resource use. We determined six new discriminators for children <1 year and ≥1 year: “Very abnormal respiratory rate”, “Abnormal heart rate”, and “Abnormal respiratory rate”, with optimal cut-offs, and specific subgroups of flowcharts. Application of the modified MTS reclassified 744 patients (2.5%). Sensitivity increased from 0.66 (95%CI 0.60–0.72) to 0.71 (0.66–0.75) for high urgency patients and from 0.67 (0.54–0.76) to 0.70 (0.58–0.80) for high and intermediate urgency patients. Specificity decreased from 0.90 (0.86–0.93) to 0.89 (0.85–0.92) for high and 0.66 (0.52–0.78) to 0.63 (0.50–0.75) for high and intermediate urgency patients. These differences were statistically significant. Overall performance improved (R² 0.199 versus 0.204).

Conclusions

Six new discriminators based on vital signs lead to a small but relevant increase in performance and should be implemented in the MTS.

Variation in hospital admission in febrile children evaluated at the Emergency Department (ED) in Europe: PERFORM, a multicentre prospective observational study

Objectives

Hospitalisation is frequently used as a marker of disease severity in observational Emergency Department (ED) studies. The comparison of ED admission rates is complex in potentially being influenced by the characteristics of the region, ED, physician and patient. We aimed to study variation in ED admission rates of febrile children, to assess whether variation could be explained by disease severity and to identify patient groups with large variation, in order to use this to reduce unnecessary health care utilization that is often due to practice variation.

Design

MOFICHE (Management and Outcome of Fever in children in Europe, part of the PERFORM study, www.perform2020.org), is a prospective cohort study using routinely collected data on febrile children regarding patient characteristics (age, referral, vital signs and clinical alarming signs), diagnostic tests, therapy, diagnosis and hospital admission.

Setting and participants

Data were collected on febrile children aged 0–18 years presenting to 12 European EDs (2017–2018).

Main outcome measures

We compared admission rates between EDs by using standardised admission rates after adjusting for patient characteristics and initiated tests at the ED, where standardised rates >1 demonstrate higher admission rates than expected and rates <1 indicate lower rates than expected based on the ED patient population.

Results

We included 38,120 children. Of those, 9.695 (25.4%) were admitted to a general ward (range EDs 5.1–54.5%). Adjusted standardised admission rates ranged between 0.6 and 1.5. The largest variation was seen in short admission rates (0.1–5.0), PICU admission rates (0.2–2.2), upper respiratory tract infections (0.4–1.7) and fever without focus (0.5–2.7). Variation was small in sepsis/meningitis (0.9–1.1).

Conclusions

Large variation exists in admission rates of febrile children evaluated at European EDs, however, this variation is largely reduced after correcting for patient characteristics and therefore overall admission rates seem to adequately reflect disease severity or a potential for a severe disease course. However, for certain patient groups variation remains high even after adjusting for patient characteristics.

Management of children visiting the emergency department during out-of-office hours: an observational study

BACKGROUND

The aim was to study the characteristics and management of children visiting the emergency department (ED) during out-of-office hours.

METHODS

We analysed electronic health record data from 119 204 children visiting one of five EDs in four European countries. Patient characteristics and management (diagnostic tests, treatment, hospital admission and paediatric intensive care unit admission) were compared between children visiting during office hours and evening shifts, night shifts and weekend day shifts. Analyses were corrected for age, gender, Manchester Triage System urgency, abnormal vital signs, presenting problems and hospital.

RESULTS

Patients presenting at night were younger (median (IQR) age: 3.7 (1.4-8.2) years vs 4.8 (1.8-9.9)), more often classified as high urgent (16.3% vs 9.9%) and more often had ≥2 abnormal vital signs (22.8% vs 18.1%) compared with office hours. After correcting for disease severity, laboratory and radiological tests were less likely to be requested (adjusted OR (aOR): 0.82, 95% CI 0.78-0.86 and aOR: 0.64, 95% CI 0.60-0.67, respectively); treatment was more likely to be undertaken (aOR: 1.56, 95% CI 1.49-1.63) and patients were more likely to be admitted to the hospital (aOR: 1.32, 95% CI 1.24-1.41) at night. Patterns in management during out-of-office hours were comparable between the different hospitals, with variability remaining.

CONCLUSIONS

Children visiting during the night are relatively more seriously ill, highlighting the need to keep improving emergency care on a 24-hour-a-day basis. Further research is needed to explain the differences in management during the night and how these differences affect patient outcomes.