Validation of a pediatric early warning system for hospitalized pediatric oncology patients in a resource-limited setting

Oncological pediatric early warning score: a dedicated tool to predict patient's clinical deterioration and need for pediatric intensive care treatment

Pediatric oncohematological patients frequently require PICU admission during their clinical history. The O-PEWS is a specific score developed to predict the need for PICU admission of oncohematological children. This study aimed at i) describing the trend of the O-PEWS in a cohort of patients hospitalized in the Pediatric Oncohematology ward and transferred to the PICU of Padua University Hospital, measured at different time-points in the 24 hours before PICU admission and to evaluate its association with mortality and presence of organ failure; ii) investigating the association between the recorded O-PEWS, and PIM3, number of organ failure and the need for ventilation, dialysis and inotropes.

This retrospective single-center study enrolled oncohematological children admitted to the PICU between 2017 and 2021. The O-PEWS, ranging between 0 and 15, was calculated on the available medical records and the TIPNet-Network database at 24 (T-24), 12 (T-12), 6 (T-6) and 0 (T0) hours before PICU admission.

RESULTS: 101 PICU admissions, related to 80 children, were registered. During the 24 hours prior to PICU admission, the O-PEWS progressively increased in all the patients. At T-24 the median O-PEWS was 3 (IQR 1-5), increasing to a median value of 6 (IQR 4-8) at T0. The O-PEWS was positively associated with mortality, organ failure and the need for ventilation at all the analyzed time-points and with the need for dialysis at T-6.

The O-PEWS appears as a useful tool for predicting early clinical deterioration in oncohematological patients and for anticipating the initiation of life-support treatments.

Connecting Clinical Capacity and Intervention Sustainability in Resource-Variable Pediatric Oncology Centers in Latin America

Clinical capacity for sustainability, or the clinical resources needed to sustain an evidence-based practice, represent proximal determinants that contribute to intervention sustainment. We examine the relationship between clinical capacity for sustainability and sustainment of PEWS, an evidence-based intervention to improve outcomes for pediatric oncology patients in resource-variable hospitals. We conducted a cross-sectional survey among Latin American pediatric oncology centers participating in Proyecto Escala de Valoración de Alerta Temprana (EVAT), an improvement collaborative to implement Pediatric Early Warning Systems (PEWS). Hospitals were eligible if they had completed PEWS implementation. Clinicians were eligible to participate if they were involved in PEWS implementation or used PEWS in clinical work. The Spanish language survey consisted of 56 close and open-ended questions about the respondent, hospital, participants' assessment of clinical capacity to sustain PEWS using the clinical sustainability assessment tool (CSAT), and perceptions about PEWS and its use as an intervention. Results were analyzed using a multi-level modeling approach to examine the relationship between individual, hospital, intervention, and clinical capacity determinants to PEWS sustainment. A total of 797 responses from 37 centers in 13 countries were included in the analysis. Eighty-seven percent of participants reported PEWS sustainment. After controlling for individual, hospital, and intervention factors, clinical capacity was significantly associated with PEWS sustainment (OR 3.27, p < .01). Marginal effects from the final model indicate that an increasing capacity score has a positive influence (11% for every additional CSAT point) of predicting PEWS sustainment. PEWS is a sustainable intervention and clinical capacity to sustain PEWS contributes meaningfully to PEWS sustainment.

Sustainability determinants of an intervention to identify clinical deterioration and improve childhood cancer survival in Latin American hospitals: the INSPIRE study protocol

BACKGROUND

More than 90% of children with cancer live in low-resourced settings, where survival is only 20%. Sustainable evidence-based (EB) interventions yielding ongoing beneficial patient outcomes are critical to improve childhood cancer survival. A better understanding of factors promoting intervention sustainability in these settings is urgently needed. The aim of this study is to provide an empirical understanding of how clinical capacity for sustainability, or the resources needed to sustain an intervention, impacts the sustainment of Pediatric Early Warning System (PEWS), an EB intervention that improves pediatric oncology outcomes in low-resource hospitals by detecting clinical deterioration and preventing the need for more intense treatment.

METHODS

We will conduct a prospective, longitudinal study of approximately 100 resource-variable hospitals implementing and sustaining PEWS participating in Proyecto EVAT, a quality improvement collaborative of Latin American pediatric oncology centers. Aim 1: We will evaluate how clinical capacity for sustainability changes over time through 5 to 9 prospective measurements of capacity via survey of clinical staff using PEWS (approximately n = 13 per center) during the phases of PEWS adoption, implementation, and sustainability using the Clinical Sustainability Assessment Tool (CSAT). Aim 2: We will determine the relationship between capacity and a) PEWS sustainment and b) clinical deterioration mortality among pediatric oncology patients at centers sustaining PEWS for 2 to 10 years using chart review and an existing patient outcomes registry. Aim 3: We will develop novel strategies to promote sustainability by gaining a deeper understanding of perceived challenges to building capacity and PEWS sustainment. In combination with quantitative outcomes, we will conduct 24 focus groups with staff (doctors, nurses, and administrators) from hospitals with both high (n = 4) and low capacity (n = 4). We will then use implementation mapping to generate theoretically driven, empirically-supported sustainability strategies.

DISCUSSION

This study will advance implementation science by providing a theoretically driven, foundational understanding of factors that predict sustainability among a large, diverse cohort of hospitals. We will then use this knowledge to develop sustainability evidence-informed strategies that optimize capacity and promote long-term sustainment of PEWS and improvements in patient outcomes, thus promoting equity in childhood cancer care globally.

Evaluating the Validity of the Responses to Illness Severity Quantification Score to Discriminate Illness Severity and Level of Care Transitions in Hospitalized Children with Severe Acute Malnutrition

OBJECTIVE

To evaluate the validity of the Responses to Illness Severity Quantification (RISQ) score to discriminate illness severity and transitions between levels of care during hospitalization.

STUDY DESIGN

A prospective observational study conducted in Maiduguri, Nigeria, enrolled inpatients aged 1-59 months with severe acute malnutrition. The primary outcome was the RISQ score associated with the patient state. Heart and respiratory rate, oxygen saturation, respiratory effort, oxygen use, temperature, and level of consciousness are summed to calculate the RISQ score. Five states were defined by levels of care and hospital discharge outcome. The states were classified hierarchically, reflecting illness severity: hospital mortality was the most severe state, then intensive care unit (ICU), care in the stabilization phase (SP), care in the rehabilitation phase (RP), and lowest severity, survival at hospital discharge. A multistate statistical model examined performance of the RISQ score in predicting clinical states and transitions.

RESULTS

Of 903 children enrolled (mean age, 14.6 months), 63 (7%) died. Mean RISQ scores during care in each phase were 3.5 (n = 2265) in the ICU, 1.7 (n = 6301) in the SP, and 1.5 (n = 2377) in the RP. Mean scores and HRs for a 3-point change in score at transitions: ICU to death, 6.9 (HR, 1.80); SP to ICU, 2.8 (HR, 2.00); ICU to SP, 2.0 (HR, 0.5); and RP to discharge, 1.4 (HR, 0.91).

CONCLUSIONS

The RISQ score can discriminate between points of escalation or de-escalation of care and reflects illness severity in hospitalized children with severe acute malnutrition. Evaluation of clinical implementation and demonstration of benefit will be important before widespread adoption.

Treatment-related mortality in children with cancer in low-income and middle-income countries: a systematic review and meta-analysis

BACKGROUND

Approximately 90% of children with cancer live in low-income and middle-income countries (LMICs), where 5-year survival is lower than 20%. Treatment-related mortality in high-income countries is approximately 3-5%; however, in LMICs, treatment-related mortality has been reported in up to 45% of children with cancer. This study aimed to systematically explore the burden of treatment-related mortality in children with cancer in LMICs and to explore the association between country income level and treatment-related mortality.

METHODS

For this systematic review and meta-analysis we identified articles published between Jan 1, 2010, and June 22, 2021, describing treatment-related mortality in paediatric patients (aged 0-21 years) with cancer in LMICs. We searched PubMed, Trip, Web of Science, Embase, and the WHO Global Metric Index databases. The search was limited to full-text articles and excluded case reports (<10 patients) and haematopoietic stem-cell transplantation recipients. Two reviewers independently screened studies for eligibility, extracted data from included publications, and evaluated data quality. Random and mixed-effects models were used to estimate treatment-related mortality burden and trends. The Cochran-Q statistic was used to assess heterogeneity between studies. This study is registered on PROSPERO (CRD42021264849).

FINDINGS

Of 13 269 identified abstracts, 501 studies representing 68 351 paediatric patients with cancer were included. The treatment-related mortality estimate was 6·82% (95% CI 5·99-7·64), accounting for 30·9% of overall mortality (4437 of 14 358 deaths). Treatment-related mortality was inversely related to country income. Treatment-related mortality was 14·19% (95% CI 9·65-18·73) in low-income countries, 9·21% (7·93-10·49) in lower-middle-income countries, and 4·47% (3·42-5·53) in upper-middle-income countries (Cochran-Q 42·39, p<0·0001). In upper-middle-income countries, the incidence of treatment-related mortality decreased over time (slope -0·002, p=0·0028); however, outcomes remained unchanged in low-income (p=0·21) and lower-middle-income countries (p=0·16).

INTERPRETATION

Approximately one in 15 children receiving cancer treatment in LMICs die from treatment-related complications. Although treatment-related mortality has decreased in upper-middle-income countries over time, it remains unchanged in LMICs. There is an urgent need for targeted supportive care interventions to reduce global disparities in childhood cancer survival.

FUNDING

American Lebanese Syrian Associated Charities and National Cancer Institute.

Predicting Clinical Deterioration and Mortality at Differing Stages During Hospitalization: A Systematic Review of Risk Prediction Models in Children in Low- and Middle-Income Countries

OBJECTIVE

To determine which risk prediction model best predicts clinical deterioration in children at different stages of hospital admission in low- and middle-income countries.

METHODS

For this systematic review, Embase and MEDLINE databases were searched, and Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed. The key search terms were "development or validation study with risk-prediction model" AND "deterioration or mortality" AND "age 0-18 years" AND "hospital-setting: emergency department (ED), pediatric ward (PW), or pediatric intensive care unit (PICU)" AND "low- and middle-income countries." The Prediction Model Risk of Bias Assessment Tool was used by two independent authors. Forest plots were used to plot area under the curve according to hospital setting. Risk prediction models used in two or more studies were included in a meta-analysis.

RESULTS

We screened 9486 articles and selected 78 publications, including 67 unique predictive models comprising 1.5 million children. The best performing models individually were signs of inflammation in children that can kill (SICK) (ED), pediatric early warning signs resource limited settings (PEWS-RL) (PW), and Pediatric Index of Mortality (PIM) 3 as well as pediatric sequential organ failure assessment (pSOFA) (PICU). Best performing models after meta-analysis were SICK (ED), pSOFA and Pediatric Early Death Index for Africa (PEDIA)-immediate score (PW), and pediatric logistic organ dysfunction (PELOD) (PICU). There was a high risk of bias in all studies.

CONCLUSIONS

We identified risk prediction models that best estimate deterioration, although these risk prediction models are not routinely used in low- and middle-income countries. Future studies should focus on large scale external validation with strict methodological criteria of multiple risk prediction models as well as study the barriers in the way of implementation.

TRIAL REGISTRATION

PROSPERO International Prospective Register of Systematic Reviews: Prospero ID: CRD42021210489.

Effect of paediatric early warning systems (PEWS) implementation on clinical deterioration event mortality among children with cancer in resource-limited hospitals in Latin America: a prospective, multicentre cohort study

BACKGROUND

Paediatric early warning systems (PEWS) aid in the early identification of clinical deterioration events in children admitted to hospital. We aimed to investigate the effect of PEWS implementation on mortality due to clinical deterioration in children with cancer in 32 resource-limited hospitals across Latin America.

METHODS

Proyecto Escala de Valoración de Alerta Temprana (Proyecto EVAT) is a quality improvement collaborative to implement PEWS in hospitals providing childhood cancer care. In this prospective, multicentre cohort study, centres joining Proyecto EVAT and completing PEWS implementation between April 1, 2017, and May 31, 2021, prospectively tracked clinical deterioration events and monthly inpatient-days in children admitted to hospital with cancer. De-identified registry data reported between April 17, 2017, and Nov 30, 2021, from all hospitals were included in analyses; children with limitations on escalation of care were excluded. The primary outcome was clinical deterioration event mortality. Incidence rate ratios (IRRs) were used to compare clinical deterioration event mortality before and after PEWS implementation; multivariable analyses assessed the correlation between clinical deterioration event mortality and centre characteristics.

FINDINGS

Between April 1, 2017, and May 31, 2021, 32 paediatric oncology centres from 11 countries in Latin America successfully implemented PEWS through Proyecto EVAT; these centres documented 2020 clinical deterioration events in 1651 patients over 556 400 inpatient-days. Overall clinical deterioration event mortality was 32·9% (664 of 2020 events). The median age of patients with clinical deterioration events was 8·5 years (IQR 3·9-13·2), and 1095 (54·2%) of 2020 clinical deterioration events were reported in male patients; data on race or ethnicity were not collected. Data were reported per centre for a median of 12 months (IQR 10-13) before PEWS implementation and 18 months (16-18) after PEWS implementation. The mortality rate due to a clinical deterioration event was 1·33 events per 1000 patient-days before PEWS implementation and 1·09 events per 1000 patient-days after PEWS implementation (IRR 0·82 [95% CI 0·69-0·97]; p=0·021). In the multivariable analysis of centre characteristics, higher clinical deterioration event mortality rates before PEWS implementation (IRR 1·32 [95% CI 1·22-1·43]; p<0·0001), being a teaching hospital (1·18 [1·09-1·27]; p<0·0001), not having a separate paediatric haematology-oncology unit (1·38 [1·21-1·57]; p<0·0001), and having fewer PEWS omissions (0·95 [0·92-0·99]; p=0·0091) were associated with a greater reduction in clinical deterioration event mortality after PEWS implementation; no association was found with country income level (IRR 0·86 [95% CI 0·68-1·09]; p=0·22) or clinical deterioration event rates before PEWS implementation (1·04 [0·97-1·12]; p=0·29).

INTERPRETATION

PEWS implementation was associated with reduced clinical deterioration event mortality in paediatric patients with cancer across 32 resource-limited hospitals in Latin America. These data support the use of PEWS as an effective evidence-based intervention to reduce disparities in global survival for children with cancer.

FUNDING

American Lebanese Syrian Associated Charities, US National Institutes of Health, and Conquer Cancer Foundation.

TRANSLATIONS

For the Spanish and Portuguese translations of the abstract see Supplementary Materials section.

Stages of change: Strategies to promote use of a Pediatric Early Warning System in resource-limited pediatric oncology centers

BACKGROUND

Pediatric Early Warning Systems (PEWS) assist early detection of clinical deterioration in hospitalized children with cancer. Relevant to successful PEWS implementation, the "stages of change" model characterizes stakeholder support for PEWS based on willingness and effort to adopt the new practice.

METHODS

At five resource-limited pediatric oncology centers in Latin America, semi-structured interviews were conducted with 71 hospital staff involved in PEWS implementation. Purposive sampling was used to select centers requiring variable time to complete PEWS implementation, with low-barrier centers (3-4 months) and high-barrier centers (10-11 months). Interviews were conducted in Spanish, professionally transcribed, and translated into English. Thematic content analysis explored "stage of change" with constant comparative analysis across stakeholder types and study sites.

RESULTS

Participants identified six interventions (training, incentives, participation, evidence, persuasion, and modeling) and two policies (environmental planning and mandates) as effective strategies used by implementation leaders to promote stakeholder progression through stages of change. Key approaches involved presentation of evidence demonstrating PEWS effectiveness, persuasion and incentives addressing specific stakeholder interests, enthusiastic individuals serving as models for others, and policies enforced by hospital directors facilitating habitual PEWS use. Effective engagement targeted hospital directors during early implementation phases to provide programmatic legitimacy for clinical staff.

CONCLUSION

This study identifies strategies to promote adoption and maintained use of PEWS, highlighting the importance of tailoring implementation strategies to the motivations of each stakeholder type. These findings can guide efforts to implement PEWS and other evidence-based practices that improve childhood cancer outcomes in resource-limited hospitals.

A new measure for multi-professional medical team communication: design and methodology for multilingual measurement development

Background

As implementation science in global health continues to evolve, there is a need for valid and reliable measures that consider diverse linguistic and cultural contexts. A standardized, reproducible process for multilingual measure development may improve accessibility and validity by participants in global health settings. To address this need, we propose a rigorous methodology for multilingual measurement development. We use the example of a novel measure of multi-professional team communication quality, a determinant of implementation efforts.

Methods

The development and translation of this novel bilingual measure is comprised of seven steps. In this paper, we describe a measure developed in English and Spanish, however, this approach is not language specific. Participants are engaged throughout the process: first, an interprofessional panel of experts and second, through cognitive interviewing for measure refinement. The steps of measure development included: (1) literature review to identify previous measures of team communication; (2) development of an initial measure by the expert panel; (3) cognitive interviewing in a phased approach with the first language (English); (4): formal, forward-backward translation process with attention to colloquialisms and regional differences in languages; (5) cognitive interviewing repeated in the second language (Spanish); (6) language synthesis to refine both instruments and unify feedback; and (7) final review of the refined measure by the expert panel.

Results

A draft measure to assess quality of multi-professional team communication was developed in Spanish and English, consisting of 52 questions in 7 domains. This measure is now ready for psychometric testing.

Conclusions

This seven-step, rigorous process of multilingual measure development can be used in a variety of linguistic and resource settings. This method ensures development of valid and reliable tools to collect data from a wide range of participants, including those who have historically been excluded due to language barriers. Use of this method will increase both rigor and accessibility of measurement in implementation science and advance equity in research and practice.

The COVID-19 Pandemic's impact on sustainability and expansion of a Pediatric Early Warning System in resource-limited hospitals

BACKGROUND

The COVID-19 pandemic impacted healthcare delivery worldwide, including pediatric cancer care, with a disproportionate effect in resource-limited settings. This study evaluates its impact on existing quality improvement (QI) programs.

METHODS

We conducted 71 semi-structured interviews of key stakeholders at five resource-limited pediatric oncology centers participating in a collaborative to implement Pediatric Early Warning System (PEWS). Interviews were conducted virtually using a structured interview guide, recorded, transcribed, and translated into English. Two coders developed a codebook of a priori and inductive codes and independently coded all transcripts, achieving a kappa of 0.8-0.9. Thematic analysis explored the impact of the pandemic on PEWS.

RESULTS

All hospitals reported limitations in material resources, reduction in staffing, and impacts on patient care due to the pandemic. However, the impact on PEWS varied across centers. Identified factors that promoted or limited ongoing PEWS use included the availability of material resources needed for PEWS, staff turnover, PEWS training for staff, and the willingness of staff and hospital leaders to prioritize PEWS. Consequently, some hospitals were able to sustain PEWS; others halted or reduced PEWS use to prioritize other work. Similarly, the pandemic delayed plans at all hospitals to expand PEWS to other units. Several participants were hopeful for future expansion of PEWS post-pandemic.

CONCLUSION

The COVID-19 pandemic created challenges for sustainability and scale of PEWS, an ongoing QI program, in these resource-limited pediatric oncology centers. Several factors mitigated these challenges and promoted ongoing PEWS use. These results can guide strategies to sustain effective QI interventions during future health crises.

Development and pilot testing of PROACTIVE: A pediatric onco-critical care capacity and quality assessment tool for resource-limited settings

BACKGROUND

Nearly 90% children with cancer reside in low- and middle-income countries, which face multiple challenges delivering high-quality pediatric onco-critical care (POCC). We recently identified POCC quality and capacity indicators for PROACTIVE (PediatRic Oncology cApaCity assessment Tool for IntensiVe carE), a tool that evaluates strengths and limitations in POCC services. This study describes pilot testing of PROACTIVE, development of center-specific reports, and identification of common POCC challenges.

METHODS

The original 119 consensus-derived PROACTIVE indicators were converted into 182 questions divided between 2 electronic surveys for intensivists and oncologists managing critically ill pediatric cancer patients. Alpha-testing was conducted to confirm face-validity with four pediatric intensivists. Eleven centers representing diverse geographic regions, income levels, and POCC services conducted beta-testing to evaluate usability, feasibility, and applicability of PROACTIVE. Centers' responses were scored and indicators with mean scores ≤75% in availability/performance were classified as common POCC challenges.

RESULTS

Alpha-testing ensured face-validity and beta-testing demonstrated feasibility and usability of PROACTIVE (October 2020-June 2021). Twenty-two surveys (response rate 99.4%) were used to develop center-specific reports. Adjustments to PROACTIVE were made based on focus group feedback and surveys, resulting in 200 questions. Aggregated data across centers identified common POCC challenges: (1) lack of pediatric intensivists, (2) absence of abstinence and withdrawal symptoms monitoring, (3) shortage of supportive care resources, and (4) limited POCC training for physicians and nurses.

CONCLUSIONS

PROACTIVE is a feasible and contextually appropriate tool to help clinicians and organizations identify challenges in POCC services across a wide range of resource-levels. Widespread use of PROACTIVE can help prioritize and develop tailored interventions to strengthen POCC services and outcomes globally.

Impact of hospital characteristics on implementation of a Pediatric Early Warning System in resource-limited cancer hospitals

Background

Pediatric Early Warning Systems (PEWS) aid in identification of deterioration in hospitalized children with cancer but are underutilized in resource-limited settings. Proyecto EVAT is a multicenter quality improvement (QI) collaborative in Latin America to implement PEWS. This study investigates the relationship between hospital characteristics and time required for PEWS implementation.

Methods

This convergent mixed-methods study included 23 Proyecto EVAT childhood cancer centers; 5 hospitals representing quick and slow implementers were selected for qualitative analysis. Semi-structured interviews were conducted with 71 stakeholders involved in PEWS implementation. Interviews were recorded, transcribed and translated to English, then coded using a priori and novel codes. Thematic content analysis explored the impact of hospital characteristics and QI experience on time required for PEWS implementation and was supplemented by quantitative analysis exploring the relationship between hospital characteristics and implementation time.

Results

In both quantitative and qualitative analysis, material and human resources to support PEWS significantly impacted time to implementation. Lack of resources produced various obstacles that extended time necessary for centers to achieve successful implementation. Hospital characteristics, such as funding structure and type, influenced PEWS implementation time by determining their resource-availability. Prior hospital or implementation leader experience with QI, however, helped facilitate implementation by assisting implementers predict and overcome resource-related challenges.

Conclusions

Hospital characteristics impact time required to implement PEWS in resource-limited childhood cancer centers; however, prior QI experience helps anticipate and adapt to resource challenges and more quickly implement PEWS. QI training should be a component of strategies to scale-up use of evidence-based interventions like PEWS in resource-limited settings.

Validation of a modified bedside Pediatric Early Warning System score for detection of clinical deterioration in hospitalized pediatric oncology patients: A prospective cohort study

BACKGROUND

Hospitalized pediatric oncology patients are at risk of severe clinical deterioration. Yet Pediatric Early Warning System (PEWS) scores have not been prospectively validated in these patients. We aimed to determine the predictive performance of the modified BedsidePEWS score for unplanned pediatric intensive care unit (PICU) admission and cardiopulmonary resuscitation (CPR) in this patient population.

METHODS

We performed a prospective cohort study in an 80-bed pediatric oncology hospital in the Netherlands, where care has been nationally centralized. All hospitalized pediatric oncology patients aged 0-18 years were eligible for inclusion. A Cox proportional hazard model was estimated to study the association between BedsidePEWS score and unplanned PICU admissions or CPR. The predictive performance of the model was internally validated by bootstrapping.

RESULTS

A total of 1137 patients were included. During the study, 103 patients experienced 127 unplanned PICU admissions and three CPRs. The hazard ratio for unplanned PICU admission or CPR was 1.65 (95% confidence interval [CI]: 1.59-1.72) for each point increase in the modified BedsidePEWS score. The discriminative ability was moderate (D-index close to 0 and a C-index of 0.83 [95% CI: 0.79-0.90]). Positive and negative predictive values of modified BedsidePEWS score at the widely used cutoff of 8, at which escalation of care is required, were 1.4% and 99.9%, respectively.

CONCLUSION

The modified BedsidePEWS score is significantly associated with requirement of PICU transfer or CPR. In pediatric oncology patients, this PEWS score may aid in clinical decision-making for timing of PICU transfer.

Establishing nursing-sensitive quality indicators for pediatric oncology: An international mixed methods Delphi study

INTRODUCTION

Nursing-sensitive indicators (NSIs) measure factors influencing nursing care quality and patient outcomes. Established NSIs reflect general and select specialty nursing practices. However, a core set of NSIs for international pediatric oncology nursing practice does not currently exist. Without valid and reliable quality indicators, the impact of nursing care on children and adolescents with cancer cannot be effectively measured and improved. The purpose of this study was to develop a preliminary core set of NSIs for international pediatric oncology nursing that would be important, actionable, and feasible to measure across varied resource settings and countries.

DESIGN/METHODS

A multiphase sequential mixed methods research design, intersected with a classical Delphi method, was utilized. Through purposive snowball sampling, 122 expert pediatric oncology nurses from 43 countries participated. Round One: Panelists identified five potential NSIs and constructs. Open-ended responses were coded and categorized through descriptive content analysis and integrated into the next round. Round Two: Panelists selected their top 10 NSIs and constructs and ranked them by importance to patient care quality. Mean importance scores were calculated through reverse scoring; the top 10 NSIs and constructs were integrated into the next round. Round Three: Panelists ranked the top 10 NSIs and constructs by order of importance for this particular population, then rated each NSI/Construct for actionability and feasibility of measurement by Likert-scale. Rounds Two and Three were analyzed using descriptive statistics. Mixed methods meta-inferences were derived from the integration of Rounds One and Three findings.

RESULTS

Eighty-five (70%) panelists from 38 countries completed all Delphi survey rounds. The preliminary core set of NSIs and constructs identified by the expert panel, and ranked in order of importance, were as follows: safe chemotherapy administration and handling, infection prevention/control, pediatric oncology nursing orientation program, early warning score system/recognition of patient deterioration, chemotherapy/biotherapy education/course, pain assessment/management, symptom assessment/management, patient and family education, palliative/end of life care, and continuing nursing education/competency. All NSIs and constructs were rated as actionable; all but palliative/end of life care were rated as feasible to measure. Each of the 10 NSIs and constructs were nominated in Round One by at least one expert panelist from low- and middle-income and high-income countries, and at least one panelist from the Americas.

CONCLUSION

Preliminary core NSIs and constructs provide insight into common attributes of international pediatric oncology nursing practice that are important, actionable, and feasible for quality measurement.

CLINICAL RELEVANCE

NSIs have the potential to drive quality improvement, guide comparison with other institutions, promote knowledge-sharing, and advance pediatric oncology nursing outcomes around the world. These NSIs and constructs may also be relevant to other pediatric and adult oncology settings.

A qualitative study of barriers and facilitators to pediatric early warning score (PEWS) implementation in a resource-limited setting

Objectives

Globally, pediatric hospitals have implemented Pediatric Early Warning Scores (PEWS) to standardize escalation of care and improve detection of clinical deterioration in pediatric patients. This study aims to utilize qualitative methodology to understand barriers and facilitators of PEWS implementation at Philippine Children's Medical Center (PCMC), a tertiary care hospital in Manila, Philippines.

Methods

Semi-structured interviews querying current processes for clinical monitoring, Pediatric Intensive Care Unit (PICU) transfer, and clinician attitudes towards PEWS implementation were audio recorded. In-person hospital observations served to triangulate interview findings. The Systems Engineering Initiative for Patient Safety (SEIPS) framework guided content coding of interviews to characterize work systems, processes, and outcomes related to patient monitoring and care escalation. Thematic coding was performed using Dedoose software. This model allowed identification of barriers and facilitators to PEWS implementation.

Results

Barriers within PCMC workflow included: limited bed capacity, delay in referral, patient overflow, limited monitoring equipment, and high patient to staff ratio. Facilitators of PEWS implementation included support for PEWS adaptation and existence of systems for vital sign monitoring. Observations by study personnel confirmed validity of themes.

Conclusion

Utilizing qualitative methodology to understand barriers and facilitators to PEWS in specific contexts can guide implementation at resource-limited hospitals.

Utility of Pediatric Early Warning Sign Score in Predicting Outcome of PICU Admissions at a Suburban Tertiary Care Hospital

Assessment of the severity of illness is very important in intensive care unit care for quality assessment, assessing prognosis, and proper counseling. The goal of the study was to see how well the Pediatric Early Warning Sign (PEWS) score predicted the outcome of pediatric intensive care unit patients. This prospective cross-sectional study included children younger than 18 years. PEWS was calculated at presentation. The outcomes analyzed were mortality (primary outcome), need for mechanical ventilation, inotropic support, and length of stay (LOS). A median score was calculated and compared across the outcome groups. The performance of the PEWS was assessed for calibration and discrimination, and the best cutoff was determined. This study included 237 patients with a median score of 6 (range 4–9). Twenty-two (9.3%) patients required ventilator support and 66 (26.6%) inotropic support. The overall mortality rate was 5.1%, and 16.4% had prolonged LOS (>4 days). The median score of patients was significantly higher among those who died (8.5 vs. 6; p = 0.001), required ventilator support (8 vs. 6; p = 0.001), inotropic support (7 vs. 6; p = 0.030), and prolonged LOS (7 vs. 6; p = 0.001). On calibration, PEWS was found to have a good fit to predict mortality, the need for ventilator support, inotropic support, and prolonged LOS. Receiver operating characteristic curves for the PEWS model yield an area under the curve of 0.966 for mortality, 0.951 for ventilator support, 0.626 for inotropic support, and 0.760 for prolonged LOS. A cutoff value of > 7 was found to be the best to predict the outcome. PEWS is a robust tool to easily prognosticate the patient on the basis of clinical parameters.

Outcomes for critical illness in children with cancer: Analysis of risk factors for adverse outcome and resource utilization from a specialized center in Mexico

Introduction

Children with cancer have a higher risk of adverse outcomes during critical illness than general pediatric populations. In Low- and middle-income countries, lack of resources can further negatively impact outcomes in critically ill children with cancer.

Methods

In this study, we describe the outcomes of a large cohort of children with cancer including mortality and resource utilization. We performed a retrospective review of all patients admitted to our PICU between December 12th, 2013 and December 31st, 2019. Outcomes were defined as recovery or death and resource utilization was described via use of critical care interventions, Length of stay as well as PICU- and Mechanical Ventilation- free days.

Results

Overall mortality was 6.9% while mortality in the unplanned admissions was 9.1%. This remained lower than expected mortality based on PIM2 scoring. Type of PICU admission, Neurological Deterioration as a cause of PICU admission, and PIM2 were significant as risk factors in univariate analysis, but only PIM2 remained significant in the multivariate analysis.

Discussion

Our Study shows that high survival rates are achievable for children with cancer with critical illness in resource-limited settings with provision of high-quality critical care. Organizational and clinical practice facilitating quality improvement and early identification and management of critical illness may attenuate the impact of known risk factors for mortality in this population.

A prediction model for the efficacy of continuous positive airway pressure on bronchiolitis

Objectives

Prediction of the efficacy of continuous positive airway pressure (CPAP) on bronchiolitis is necessary for timely treatment. This study aims to establish a nomogram for efficacy of CPAP on bronchiolitis, and compares accuracy with Pediatric Risk of Mortality III (PRISM III), Brighton Pediatric Early Warning Score (Brighton PEWS) and Pediatric Critical Illness Score (PCIS).

Methods

From February 2014 to December 2020, data on children diagnosed with bronchiolitis and treated with CPAP in Chongqing was collected. The nomogram was evaluated by using multivariate logistic regression analysis. We compared the predictive value of model with PRISM III, PEWS and PCIS.

Results

A total of 510 children were included. The nomogram prediction model including fever, APTT, white blood cells, serum potassium concentration, lactic acid, immunodeficiency, atelectasis, lung consolidation, congenital airway dysplasia and congenital heart disease was established. The AUC of the nomogram was 0.919 in the training set and 0.947 in the validating set. The model fitted well, as evidenced by the calibration curve and Hosmer-Lemeshow goodness-of-fit test. We discovered that the nomogram significantly performed better than PRISM III, PCIS and PEWS.

Conclusions

A nomogram including ten factors for predicting the efficacy of CPAP on bronchiolitis was established. It had higher performance than the PRISM III, PCIS, and PEWS in terms of clinical benefits.

Model for regional collaboration: Successful strategy to implement a pediatric early warning system in 36 pediatric oncology centers in Latin America

BACKGROUND

Pediatric early warning systems (PEWS) aid in the early identification of deterioration in hospitalized children with cancer; however, they are under-used in resource-limited settings. The authors use the knowledge-to-action framework to describe the implementation strategy for Proyecto Escala de Valoracion de Alerta Temprana (EVAT), a multicenter quality-improvement collaborative, to scale-up PEWS in pediatric oncology centers in Latin America.

METHODS

Proyecto EVAT mentored participating centers through an adaptable implementation strategy to: (1) monitor clinical deterioration in children with cancer, (2) contextually adapt PEWS, (3) assess barriers to using PEWS, (4) pilot and implement PEWS, (5) monitor the use of PEWS, (6) evaluate outcomes, and (7) sustain PEWS. The implementation outcomes assessed included the quality of PEWS use, the time required for implementation, and global program impact.

RESULTS

From April 2017 to October 2021, 36 diverse Proyecto EVAT hospitals from 13 countries in Latin America collectively managing more than 4100 annual new pediatric cancer diagnoses successfully implemented PEWS. The time to complete all program phases varied among centers, averaging 7 months (range, 3-13 months) from PEWS pilot to implementation completion. All centers ultimately implemented PEWS and maintained high-quality PEWS use for up to 18 months after implementation. Across the 36 centers, more than 11,100 clinicians were trained in PEWS, and more than 41,000 pediatric hospital admissions had PEWS used in their care.

CONCLUSIONS

Evidence-based interventions like PEWS can be successfully scaled-up regionally basis using a systematic approach that includes a collaborative network, an adaptable implementation strategy, and regional mentorship. Lessons learned can guide future programs to promote the widespread adoption of effective interventions and reduce global disparities in childhood cancer outcomes.

LAY SUMMARY

Pediatric early warning systems (PEWS) are clinical tools used to identify deterioration in hospitalized children with cancer; however, implementation challenges limit their use in resource-limited settings. Proyecto EVAT is a multicenter quality-improvement collaborative to implement PEWS in 36 pediatric oncology centers in Latin America. This is the first multicenter, multinational study reporting a successful implementation strategy (Proyecto EVAT) to regionally scale-up PEWS. The lessons learned from Proyecto EVAT can inform future programs to promote the adoption of clinical interventions to globally improve childhood cancer outcomes.

Multilevel impacts of a pediatric early warning system in resource-limited pediatric oncology hospitals

Background

Pediatric Early Warning Systems (PEWS) reduce clinical deterioration, improve interdisciplinary communication, and provide cost savings; however, little is known about how these impacts are achieved or related. This study evaluates the multi-level impacts of PEWS in resource-limited pediatric oncology centers.

Methods

We conducted 71 semi-structured interviews including physicians (45%), nurses (45%), and administrators (10%) from 5 resource-limited pediatric oncology centers in 4 Latin American countries. Interviews were conducted in Spanish, transcribed, and translated into English. A code book was developed using a priori and inductively derived codes. Transcripts were independently coded by 2 coders, achieving a kappa of 0.8-0.9. Thematic content analysis explored perceived impacts of PEWS at the level of the patient, clinician, healthcare team, and institution.

Results

PEWS improved the quality of attention for patients, reducing morbidity and mortality. Clinicians felt more knowledgeable, confident, and empowered providing patient care, resulting in greater job satisfaction. PEWS affected team dynamics by improving interdisciplinary (ward and intensive care unit) and interprofessional (physicians and nurses) relationships and communication. This ultimately led to institutional culture change with emphasis on patient safety, collaboration with other centers, and receipt of institutional awards. Together, these impacts led to hospital-wide support of ongoing PEWS use.

Conclusions

In resource-limited hospitals, PEWS use results in multi-level positive impacts on patients, clinicians, teams, and institutions, creating a feedback loop that further supports ongoing PEWS use. These findings can guide advocacy for PEWS to various stakeholders, improve PEWS effectiveness, and inform assessment of other interventions to improve childhood cancer outcomes.

Pediatric Early Warning Systems (PEWS) improve provider-family communication from the provider perspective in pediatric cancer patients experiencing clinical deterioration

BACKGROUND

Communication between providers and patients' families is an integral part of clinical care. Family concern is a validated component of Pediatric Early Warning Systems (PEWS); however, little is known about the impact of PEWS on provider-family communication.

METHODS

Semi-structured interviews were conducted with 83 ward and Pediatric Intensive Care Unit (PICU) providers involved in the care of patients with deterioration at two pediatric oncology hospitals of different resource levels: St. Jude Children's Research Hospital (n = 42) in the United States and Unidad Nacional de Oncología Pediátrica (UNOP, n = 41) in Guatemala. Interviews were conducted in the participants' native language (English or Spanish), transcribed, and translated into English. Transcripts were coded by two researchers and analyzed for thematic content surrounding family communication and concern.

RESULTS

All participants recognized patients' families as a valuable part of the care team, particularly during events requiring escalation of care. Perceived barriers to communication included limited time spent at the bedside, and, at UNOP, language and literacy challenges which occasionally limited providers' ability to assess family concern and involve families in patient care. Despite these barriers, providers perceived PEWS improved communication by facilitating more interaction with families, allowing for relationship-building, anticipatory guidance, and destigmatization of the PICU. PEWS assessments also allowed families to contribute to identification of deterioration.

CONCLUSIONS

PEWS improve the quality of communication between providers and families by providing more opportunities for interaction, building relationships, and trust. These findings further support the use of PEWS in the care of children with cancer in hospitals of all resource-levels.

The predictive performance and impact of pediatric early warning systems in hospitalized pediatric oncology patients-A systematic review

Pediatric early warning systems (PEWS) arewidely used to identify clinically deteriorating patients. Hospitalized pediatric oncology patients are particularly prone to clinical deterioration. We assessed the PEWS performance to predict early clinical deterioration and the effect of PEWS implementation on patient outcomes in pediatric oncology patients. PubMED, EMBASE, and CINAHL databases were systematically searched from inception up to March 2020. Quality assessment was performed using the Prediction model study Risk-Of-Bias Assessment Tool (PROBAST) and the Cochrane Risk-of-Bias Tool. Nine studies were included. Due to heterogeneity of study designs, outcome measures, and diversity of PEWS, it was not possible to conduct a meta-analysis. Although the studies reported high sensitivity, specificity, and area under the receiver operating characteristics curve (AUROC) of PEWS detecting inpatient deterioration, overall risk of bias of the studies was high. This review highlights limited evidence on the predictive performance of PEWS for clinical deterioration and the effect of PEWS implementation.

Challenges to sustainability of pediatric early warning systems (PEWS) in low-resource hospitals in Latin America

Background

Sustainability, or continued use of evidence-based interventions for long-term patient benefit, is the least studied aspect of implementation science. In this study, we evaluate sustainability of a Pediatric Early Warning System (PEWS), an evidence-based intervention to improve early identification of clinical deterioration in hospitalized children, in low-resource settings using the Clinical Capacity for Sustainability Framework (CCS).

Methods

We conducted a secondary analysis of a qualitative study to identify barriers and enablers to PEWS implementation. Semi-structured interviews with PEWS implementation leaders and hospital directors at 5 Latin American pediatric oncology centers sustaining PEWS were conducted virtually in Spanish from June to August 2020. Interviews were recorded, professionally transcribed, and translated into English. Exploratory thematic content analysis yielded staff perceptions on PEWS sustainability. Coded segments were analyzed to identify participant perception about the current state and importance of sustaining PEWS, as well as sustainability successes and challenges. Identified sustainability determinants were mapped to the CCS to evaluate its applicability.

Results

We interviewed 71 staff including physicians (45%), nurses (45%), and administrators (10%). Participants emphasized the importance of sustaining PEWS for continued patient benefits. Identified sustainability determinants included supportive leadership encouraging ongoing interest in PEWS, beneficial patient outcomes enhancing perceived value of PEWS, integrating PEWS into the routine of patient care, ongoing staff turnover creating training challenges, adequate material resources to promote PEWS use, and the COVID-19 pandemic. While most identified factors mapped to the CCS, COVID-19 emerged as an additional external sustainability challenge. Together, these challenges resulted in multiple impacts on PEWS sustainment, ranging from a small reduction in PEWS quality to complete disruption of PEWS use and subsequent loss of benefits to patients. Participants described several innovative strategies to address identified challenges and promote PEWS sustainability.

Conclusion

This study describes clinician perspectives on sustainable implementation of evidence-based interventions in low-resource settings, including sustainability determinants and potential sustainability strategies. Identified factors mapped well to the CCS, however, external factors, such as the COVID pandemic, may additionally impact sustainability. This work highlights an urgent need for theoretically-driven, empirically-informed strategies to support sustainable implementation of evidence-based interventions in settings of all resource-levels.

Reliability and validity of a Spanish-language measure assessing clinical capacity to sustain Paediatric Early Warning Systems (PEWS) in resource-limited hospitals

BACKGROUND

Paediatric Early Warning Systems (PEWSs) improve identification of deterioration, however, their sustainability has not been studied. Sustainability is critical to maximise impact of interventions like PEWS, particularly in low-resource settings. This study establishes the reliability and validity of a Spanish-language Clinical Sustainability Assessment Tool (CSAT) to assess clinical capacity to sustain interventions in resource-limited hospitals.

METHODS

Participants included PEWS implementation leadership teams of 29 paediatric cancer centres in Latin America involved in a collaborative to implement PEWS. The CSAT, a sustainability assessment tool validated in high-resource settings, was translated into Spanish and distributed to participants as an anonymous electronic survey. Psychometric, confirmatory factor analysis (CFA), and multivariate analyses were preformed to assess reliability, structure and initial validity. Focus groups were conducted after participants reviewed CSAT reports to assess their interpretation and utility.

RESULTS

The CSAT survey achieved an 80% response rate (n=169) with a mean score of 4.4 (of 5; 3.8-4.8 among centres). The CSAT had good reliability with an average internal consistency of 0.77 (95% CI 0.71 to 0.81); and CFAs supported the seven-domain structure. CSAT results were associated with respondents' perceptions of the evidence for PEWS, its implementation and use in their centre, and their assessment of the hospital culture and implementation climate. The mean CSAT score was higher among respondents at centres with longer time using PEWS (p<0.001). Focus group participants noted the CSAT report helped assess their centre's clinical capacity to sustain PEWS and provided constructive feedback for improvement.

CONCLUSIONS

We present information supporting the reliability and validity of the CSAT tool, the first Spanish-language instrument to assess clinical capacity to sustain evidence-based interventions in hospitals of variable resource levels. This assessment demonstrates a high capacity to sustain PEWS in these resource-limited centres with improvement over time from PEWS implementation.

Qualitative Study of Pediatric Early Warning Systems' Impact on Interdisciplinary Communication in Two Pediatric Oncology Hospitals With Varying Resources

PURPOSE

Hospitalized pediatric oncology patients are at high risk of deterioration and require frequent interdisciplinary communication to deliver high-quality care. Pediatric early warning systems (PEWS) are used by hospitals to reduce deterioration, but it is unknown how these systems affect communication about patient care in high- and limited-resource pediatric oncology settings.

METHODS

This qualitative study included semistructured interviews describing PEWS and subsequent team communication at 2 pediatric cancer centers, 1 in the United States and 1 in Guatemala. Participants included nurses, and frontline and intensive care providers who experienced recent deterioration events. Transcripts were coded and analyzed inductively using MAXQDA software.

RESULTS

The study included 41 providers in Guatemala and 42 providers in the United States (33 nurses, 30 ward providers, and 20 pediatric intensive care providers). Major themes identified include “hierarchy,” “empowerment,” “quality and method of communication,” and “trigger.” All providers described underlying medical hierarchies affecting the quality of communication regarding patient deterioration events and identified PEWS as empowering. Participants from the United States described the algorithmic approach to care and technology associated with PEWS contributing to impaired clinical judgement and a lack of communication. In both settings, PEWS sparked interdisciplinary communication and inspired action.

CONCLUSION

PEWS enhance interdisciplinary communication in high- and limited-resource study settings by empowering bedside providers. Traditional hierarchies contributed to negative communication and, in well-resourced settings, technology and automation resulted in lack of communication. Understanding contextual elements is integral to optimizing PEWS and improving pediatric oncology outcomes in hospitals of all resource levels.

Impact of PEWS on Perceived Quality of Care During Deterioration in Children With Cancer Hospitalized in Different Resource-Settings

Background

Children with cancer are at high risk for clinical deterioration and subsequent mortality. Pediatric Early Warning Systems (PEWS) have proven to reduce the frequency of clinical deterioration in hospitalized patients. This qualitative study evaluates provider perspectives on the impact of PEWS on quality of care during deterioration events in a high-resource and a resource-limited setting.

Methods

We conducted semi-structured interviews with 83 healthcare staff (nurses, pediatricians, oncology fellows, and intensivists) involved in recent deterioration events at two pediatric oncology hospitals of different resource levels: St. Jude Children’s Research Hospital (SJCRH; n = 42) and Unidad Nacional de Oncología Pediátrica (UNOP; n = 41). Interviews were conducted in the participant’s native language (English or Spanish), translated into English, and transcribed. Transcripts were coded and analyzed inductively.

Results

Providers discussed both positive and negative perspectives of clinical deterioration events. Content analysis revealed “teamwork,” “experience with deterioration,” “early awareness,” and “effective communication” as themes associated with positive perception of events, which contributed to patient safety. Negative themes included “lack of communication,” “inexperience with deterioration,” “challenges with technology”, “limited material resources,” “false positive score,” and “objective tool.” Participants representing all disciplines across both institutions shared similar positive opinions. Negative opinions, however, differed between the two institutions, with providers at UNOP highlighting limited resources while those at SJCRH expressing concerns about technology misuse.

Conclusion

Providers that care for children with cancer find PEWS valuable to improve the quality of hospital care, regardless of hospital resource-level. Identified challenges, including inadequate critical care resources and challenges with technology, differ by hospital resource-level. These findings build on growing data demonstrating the positive impact of PEWS on quality of care and encourage wide dissemination of PEWS in clinical practice.

Comparison of a new predictive model with other critical scores for predicting in-hospital mortality among children with pneumonia-related bacteremia

Prediction of mortality in children with pneumonia-related bacteremia is necessary for providing timely care and treatment. This study aims to develop and validate a nomogram and compare it with Pediatric Risk of Mortality III (PRISM III), Brighton Pediatric Early Warning Score (Brighton PEWS) and Pediatric Critical Illness Score (PCIS), which are widely used in predicting in-hospital mortality in children with pneumonia-related bacteremia. This retrospective study collected clinical data of hospitalized children with pneumonia-related bacteremia in Chongqing, China (January 2013-May 2019). The nomogram was built using multivariate logistic regression analysis. The nomogram was compared with PRISM III, PEWS and PCIS in accuracy and clinical benefits in predicting in-hospital mortality in children with pneumonia-related bacteremia. A total of 242 children were included. The nomogram including time to first positivity of blood cultures (TTFP), serum albumin (ALB) and lactate dehydrogenase (LDH) was established. The area under the receiver operating characteristic curve of the nomogram was 0.84 (95% CI 0.77 to 0.91) in the training set and 0.82 (95% CI 0.71 to 0.93) in the validating set. Good consistency was observed between the predictions and the actual observations, and the decision curve analysis showed that the nomogram was clinically useful. The results showed that the nomogram significantly performed better than the three critical scores. In conclusion, a nomogram-illustrated model incorporating TTFP, ALB and LDH for predicting in-hospital mortality in children with pneumonia-related bacteremia at the early stage was established and validated. It performed better than PRISM III, PEWS and PCIS.

Identifying the critically ill paediatric oncology patient: a study protocol for a prospective observational cohort study for validation of a modified Bedside Paediatric Early Warning System score in hospitalised paediatric oncology patients

INTRODUCTION

Hospitalised paediatric oncology patients are at risk to develop acute complications. Early identification of clinical deterioration enabling adequate escalation of care remains challenging. Various Paediatric Early Warning Systems (PEWSs) have been evaluated, also in paediatric oncology patients but mostly in retrospective or case-control study designs. This study protocol encompasses the first prospective cohort with the aim of evaluating the predictive performance of a modified Bedside PEWS score for non-elective paediatric intensive care unit (PICU) admission or cardiopulmonary resuscitation in hospitalised paediatric oncology patients.

METHODS AND ANALYSIS

A prospective cohort study will be conducted at the 80-bed Dutch paediatric oncology hospital, where all national paediatric oncology care has been centralised, directly connected to a shared 22-bed PICU. All patients between 1 February 2019 and 1 February 2021 admitted to the inpatient nursing wards, aged 0-18 years, with an International Classification of Diseases for Oncology (ICD-O) diagnosis of paediatric malignancy will be eligible. A Cox proportional hazard regression model will be used to estimate the association between the modified Bedside PEWS and time to non-elective PICU transfer or cardiopulmonary arrest. Predictive performance (discrimination and calibration) will be assessed internally using resampling validation. To account for multiple occurrences of the event of interest within each patient, the unit of study is a single uninterrupted ward admission (a clinical episode).

ETHICS AND DISSEMINATION

The study protocol has been approved by the institutional ethical review board of our hospital (MEC protocol number 16-572/C). We adapted our enrolment procedure to General Data Protection Regulation compliance. Results will be disseminated at scientific conferences, regional educational sessions and publication in peer-reviewed journals.

TRIAL REGISTRATION NUMBER

Netherlands Trial Registry (NL8957).

Clinician Emotions Surrounding Pediatric Oncology Patient Deterioration

Background

Pediatric oncology patients have a high rate of clinical deterioration frequently requiring critical care. Patient deterioration events are distressing for clinicians, but little is known about how Pediatric Early Warning Systems (PEWS) impact clinicians' emotional responses to deterioration events.

Methods

Semi-structured interviews were conducted with 83 nurses, pediatricians, oncologists, and intensive care clinicians who had recently participated in a patient deterioration event at two pediatric oncology hospitals of different resource-levels: St. Jude Children's Research Hospital (N = 42 participants) in Memphis, Tennessee or Unidad Nacional de Oncología Pediátrica (N = 41 participants) in Guatemala City, Guatemala. Interviews were conducted in the participants' native language (English or Spanish), transcribed, and translated into English. Each transcript was coded by two researchers and analyzed for thematic content.

Results

Emotions around patient deterioration including concern, fear, and frustration were reported across all disciplines at both hospitals. Concern was often triggered by an elevated PEWS score and usually resulted in increased attention, which reassured bedside clinicians that patients were receiving necessary interventions. However, persistently elevated PEWS scores, particularly at St. Jude Children's Research Hospital, occasionally resulted in a false sense of relief, diminishing clinician attention and negatively impacting patient care. Nurses at both institutions described how PEWS amplified their voices, engendering confidence and empowerment, two of the only positive emotions described in the study.

Conclusion

Clinicians experienced a range of emotions while caring for high-risk patients in the setting of clinical deterioration. These emotions have the potential to contribute to compassion fatigue and burnout, or to resilience. Acknowledgment and further investigation of the complex interplay between PEWS and clinician emotions are necessary to maximize the impact of PEWS on patient safety while simultaneously supporting staff wellbeing.

Clinical and organizational risk factors for mortality during deterioration events among pediatric oncology patients in Latin America: A multicenter prospective cohort

BACKGROUND

Hospitalized pediatric hematology-oncology (PHO) patients have frequent clinical deterioration events (CDE) requiring intensive care unit (ICU) admission, particularly in resource-limited settings. The objective of this study was to describe CDEs in hospitalized PHO patients in Latin America and to identify event-level and center-level risk factors for mortality.

METHODS

In 2017, the authors implemented a prospective registry of CDEs, defined as unplanned transfers to a higher level of care, use of ICU-level interventions on the floor, or nonpalliative floor deaths, in 16 PHO centers in 10 countries. PHO hospital admissions and hospital inpatient days were also reported. This study analyzes the first year of registry data (June 2017 to May 2018).

RESULTS

Among 16 centers, 553 CDEs were reported in PHO patients during 11,536 admissions and 119,414 inpatient days (4.63 per 1000 inpatient days). Event mortality was 29% (1.33 per 1000 inpatient days) but ranged widely across centers (11%-79% or 0.36-5.80 per 1000 inpatient days). Significant risk factors for event mortality included requiring any ICU-level intervention on the floor and not being transferred to a higher level of care. Events with organ dysfunction, a higher severity of illness, and a requirement for ICU intervention had higher mortality. In center-level analysis, hospitals with a higher volume of PHO patients, less floor use of ICU intervention, lower severity of illness on transfer, and lower rates of floor cardiopulmonary arrest had lower event mortality.

CONCLUSIONS

Hospitalized PHO patients who experience CDEs in resource-limited settings frequently require floor-based ICU interventions and have high mortality. Modifiable hospital practices around the escalation of care for these high-risk patients may contribute to poor outcomes. Earlier recognition of critical illness and timely ICU transfer may improve survival in hospitalized children with cancer.

Evolution of a Bidirectional Pediatric Critical Care Educational Partnership in a Resource-Limited Setting

Introduction: Children in resource-limited settings are disproportionately affected by common childhood illnesses, resulting in high rates of mortality. A major barrier to improving child health in such regions is limited pediatric-specific training, particularly in the care of children with critical illness. While global health rotations for trainees from North America and Europe have become commonplace, residency and fellowship programs struggle to ensure that these rotations are mutually beneficial and do not place an undue burden on host countries. We created a bidirectional, multimodal educational program between trainees in Manila, Philippines, and Baltimore, Maryland, United States, to improve the longitudinal educational experience for all participants. Program Components: Based on stakeholder input and a needs assessment, we established a global health training program in which pediatricians from the Philippines traveled to the United States for observerships, and pediatric residents from a tertiary care center in Baltimore traveled to Manila. Additionally, we created and implemented a contextualized simulation-based shock curriculum for pediatric trainees in Manila that can be disseminated locally. This bidirectional program was adapted to include telemedicine and regularly scheduled "virtual rounds" and educational case conferences during the COVID-19 pandemic. Providers from the two institutions have collaborated on educational and clinical research projects, offering opportunities for resource sharing, bidirectional professional development, and institutional improvements. Conclusion: Although creating a mutually beneficial global health partnership requires careful planning and investment over time, establishment of a successful bidirectional educational and professional development program in a limited-resource setting is feasible and benefits learners in both countries.

Performance of Pediatric Mortality Prediction Models in Low- and Middle-Income Countries: A Systematic Review and Meta-Analysis

OBJECTIVE

To describe the performance of prognostic models for mortality or clinical deterioration events among hospitalized children developed or validated in low- and middle-income countries.

STUDY DESIGN

A medical librarian systematically searched EMBASE, Ovid Medline, Scopus, Cochrane Library, EBSCO Global Health, LILACS, African Index Medicus, African Journals Online, African Healthline, Med-Carib, and Global Index Medicus (from 2000 to October 2019). We included citations that described the development or validation of a pediatric prognostic model for hospital mortality or clinical deterioration events in low- and middle-income countries. In duplicate and independently, we extracted data on included populations and model prognostic performance and evaluated risk of bias using the Prediction model Risk Of Bias Assessment Tool.

RESULTS

Of 41 279 unique citations, we included 15 studies describing 15 prognostic models for mortality and 3 models for clinical deterioration events. Six models were validated in >1 external cohort. The Lambarene Organ Dysfunction Score (0.85 [0.77-0.92]) and Signs of Inflammation in Children that Kill (0.85 [0.82-0.88]) had the highest summary C-statistics (95% CI) for discrimination. Calibration and classification measures were poorly reported. All models were at high risk of bias owing to inappropriate selection of predictor variables and handling of missing data and incomplete performance measure reporting.

CONCLUSIONS

Several prognostic models for mortality and clinical deterioration events have been validated in single cohorts, with good discrimination. Rigorous validation that conforms to current standards for prediction model studies and updating of existing models are needed before clinical implementation.

Quality and capacity indicators for hospitalized pediatric oncology patients with critical illness: A modified delphi consensus

Background

Hospitalized pediatric hematology‐oncology (PHO) patients are at high risk for critical illness, especially in resource‐limited settings. Unfortunately, there are no established quality indicators to guide institutional improvement for these patients. The objective of this study was to identify quality indicators to include in PROACTIVE (PediatRic Oncology cApaCity assessment Tool for IntensiVe carE), an assessment tool to evaluate the capacity and quality of pediatric critical care services offered to PHO patients.

Methods

A comprehensive literature review identified relevant indicators in the areas of structure, performance, and outcomes. An international focus group sorted potential indicators using the framework of domains and subdomains. A modified, three‐round Delphi was conducted among 36 international experts with diverse experience in PHO and critical care in high‐resource and resource‐limited settings. Quality indicators were ranked on relevance and actionability via electronically distributed surveys.

Results

PROACTIVE contains 119 indicators among eight domains and 22 subdomains, with high‐median importance (≥7) in both relevance and actionability, and ≥80% evaluator agreement. The top five indicators were: (a) A designated PICU area; (b) Availability of a pediatric intensivist; (c) A PHO physician as part of the primary team caring for critically ill PHO patients; (d) Trained nursing staff in pediatric critical care; and (e) Timely PICU transfer of hospitalized PHO patients requiring escalation of care.

Conclusions

PROACTIVE is a consensus‐derived tool to assess the capacity and quality of pediatric onco‐critical care in resource‐limited settings. Future endeavors include validation of PROACTIVE by correlating the proposed indicators to clinical outcomes and its implementation to identify service delivery gaps amenable to improvement.

Abnormal Vital Signs Predict Critical Deterioration in Hospitalized Pediatric Hematology-Oncology and Post-hematopoietic Cell Transplant Patients

Introduction: Hospitalized pediatric hematology-oncology and post-hematopoietic cell transplant (HCT) patients have frequent deterioration requiring Pediatric Intensive Care Unit (PICU) care. Critical deterioration (CD), defined as unplanned PICU transfer requiring life-sustaining interventions within 12 h, is a pragmatic metric to evaluate emergency response systems (ERS) in pediatrics, however, it has not been investigated in these patients. The goal of this study was to evaluate if CD is an appropriate metric to assess effectiveness of ERS in pediatric hematology-oncology and post-HCT patients and if it is preceded by an actionable period of vital sign changes.

Methods: A retrospective review of all unplanned PICU transfers and floor cardiopulmonary arrests in a dedicated pediatric hematology-oncology hospital between August 2014 and July 2016. Vital signs and physical exam findings 48 h prior to events were converted to Pediatric Early Warning System-Like Scores (PEWS-LS) using cardiovascular, respiratory, and neurologic criteria.

Results: There were 220 deterioration events, with 107 (48.6%) meeting criteria for CD, representing a rate of 2.98 per 1,000-inpatient-days. Using the first event per hospitalization (n = 184), patients with CD had higher mortality (17.4 vs. 7.6%, p = 0.045), fewer median ICU-free-days (21 vs. 24, p = 0.011), ventilator-free-days (25 vs. 28, p < 0.001), and vasoactive-free-days (27 vs. 28, p < 0.001). Using vital sign data 48 h prior to deterioration events, those with CD had higher PEWS-LS on PICU admission (p < 0.001), spent more time with elevated PEWS-LS prior to PICU transfer (p = 0.008 to 0.023) and had a longer time from first abnormal PEWS-LS (p = 0.007 to 0.043). Significant difference between the two groups was observed as early as 4 h prior to the event (p = 0.047).

Conclusion: Hospitalized pediatric hematology-oncology and post-HCT patients have frequent deterioration resulting in a high mortality. In these patients, CD is over 13 times more common than floor cardiopulmonary arrests and associated with higher mortality and fewer event-free days, making it a useful metric in these patients. CD is preceded by a long duration of abnormal vital signs, making it potentially preventable through earlier recognition.

Predictors of mortality after admission to pediatric intensive care unit in oncohematologic patients without history of hematopoietic stem cell transplantation: A single-center experience

BACKGROUND

Pediatric oncohematologic patients are a high-risk population for clinical deterioration that might require pediatric intensive care unit (PICU) admission. Several studies have described outcomes and mortality predictors for patients post hematopoietic stem cell transplantation (HSCT), but fewer data exist regarding the category of non-HSCT patients.

PROCEDURE

All oncohematologic non-HSCT patients ≤18 years requiring PICU admission from 1998 to 2015 in our tertiary-care academic hospital were retrospectively evaluated by means of the pediatric hematology-oncology unit database and the Italian PICUs data network database. We assessed the relation between demographic and clinical characteristics and 90-day mortality after PICU admission.

RESULTS

Of 3750 hospitalized oncohematologic patients, 3238 were non-HSCT and 63 (2%) of them were admitted to the PICU. Patients were mainly affected by hematological malignancies (70%) and mostly were in the induction-therapy phase. The main reasons for admission were respiratory failure (40%), sepsis (25%), and seizures (16%). The median PICU stay was 5 days (range 1-107). The mortality rate at PICU discharge was 30%, and at 90 days it was 35%. Fifty-five percent of deaths happened in the first 2 days of the PICU stay. Cardiac arrest (P = .007), presence of disseminated intravascular coagulation (DIC, P = .007), and acute kidney injury (AKI) at PICU admission (P < .001) and during PICU stay (P = .021) were significant predictors of mortality in the multivariate analysis. Respiratory failure and mechanical ventilation were not associated with mortality.

CONCLUSIONS

A relatively small percentage of non-HSCT patients required PICU admission, but the mortality rate was still high. Hemodynamic instability, DIC, and AKI, but not respiratory failure, were significant predictors of mortality.

Cost-benefit analysis of implementing a pediatric early warning system at a pediatric oncology hospital in a low-middle income country

BACKGROUND

Hospitalized pediatric oncology patients are at high risk of clinical decline and mortality, particularly in low-income and middle-income countries (LMICs). Pediatric early warning systems (PEWS) assist with the early identification of deterioration. To the authors' knowledge, no studies to date have evaluated the cost-benefit of PEWS in LMICs.

METHODS

A PEWS was implemented at the National Pediatric Oncology Unit (Unidad Nacional de Oncologia Pediatrica [UNOP]), a pediatric oncology hospital in Guatemala, resulting in a reduction in unplanned pediatric intensive care unit (PICU) transfers. Variable costs of maintaining the PICU and hospital floor were calculated for the year prior to and after the implementation of PEWS using administrative data. PEWS implementation costs were tabulated. The number of PICU inpatient days averted due to reduced unplanned PICU transfers after implementation was calculated, adjusting for changes in hospital inpatient days. Savings per inpatient day from unplanned PICU transfers were calculated. All costs were adjusted for inflation.

RESULTS

There were 457 fewer PICU inpatient days due to unplanned transfers noted the year after implementation of PEWS, adjusting for changes in hospital volume. The variable costs of an unplanned PICU transfer versus a bed on the hospital floor was $806 per day. The total cost of implementing PEWS at UNOP was $13,644 ($7 per admission). Through reductions in variable PICU costs, UNOP saved a net $173 per admission ($354,514 annual net savings) after implementation of PEWS. The cost savings were sustained in a series of more conservative 1-way sensitivity analyses.

CONCLUSIONS

Implementation of PEWS at UNOP resulted in an incremental savings due to a reduction in the number of unplanned PICU transfers. The results of the current study demonstrate that hospital investment in PEWS can improve the quality of pediatric cancer care, optimize PICU use, and reduce costs.

Validity and effectiveness of paediatric early warning systems and track and trigger tools for identifying and reducing clinical deterioration in hospitalised children: a systematic review

OBJECTIVE

To assess (1) how well validated existing paediatric track and trigger tools (PTTT) are for predicting adverse outcomes in hospitalised children, and (2) how effective broader paediatric early warning systems are at reducing adverse outcomes in hospitalised children.

DESIGN

Systematic review.

DATA SOURCES

British Nursing Index, Cumulative Index of Nursing and Allied Health Literature, Cochrane Central Register of Controlled Trials, Database of Abstracts of Reviews of Effectiveness, EMBASE, Health Management Information Centre, Medline, Medline in Process, Scopus and Web of Knowledge searched through May 2018.

ELIGIBILITY CRITERIA

We included (1) papers reporting on the development or validation of a PTTT or (2) the implementation of a broader early warning system in paediatric units (age 0-18 years), where adverse outcome metrics were reported. Several study designs were considered.

DATA EXTRACTION AND SYNTHESIS

Data extraction was conducted by two independent reviewers using template forms. Studies were quality assessed using a modified Downs and Black rating scale.

RESULTS

36 validation studies and 30 effectiveness studies were included, with 27 unique PTTT identified. Validation studies were largely retrospective case-control studies or chart reviews, while effectiveness studies were predominantly uncontrolled before-after studies. Metrics of adverse outcomes varied considerably. Some PTTT demonstrated good diagnostic accuracy in retrospective case-control studies (primarily for predicting paediatric intensive care unit transfers), but positive predictive value was consistently low, suggesting potential for alarm fatigue. A small number of effectiveness studies reported significant decreases in mortality, arrests or code calls, but were limited by methodological concerns. Overall, there was limited evidence of paediatric early warning system interventions leading to reductions in deterioration.

CONCLUSION

There are several fundamental methodological limitations in the PTTT literature, and the predominance of single-site studies carried out in specialist centres greatly limits generalisability. With limited evidence of effectiveness, calls to make PTTT mandatory across all paediatric units are not supported by the evidence base.

PROSPERO REGISTRATION NUMBER

CRD42015015326.

Provisional Validation of a Pediatric Early Warning Score for Resource-Limited Settings

BACKGROUND AND OBJECTIVES

The use of Pediatric Early Warning Scores is becoming widespread to identify and rapidly respond to patients with deteriorating conditions. The ability of Pediatric Early Warning Scores to identify children at high risk of deterioration or death has not, however, been established in resource-limited settings.

METHODS

We developed the Pediatric Early Warning Score for Resource-Limited Settings (PEWS-RL) on the basis of expert opinion and existing scores. The PEWS-RL was derived from 6 equally weighted variables, producing a cumulative score of 0 to 6. We then conducted a case-control study of admissions to the pediatrics department of the main public referral hospital in Kigali, Rwanda between November 2016 and March 2017. We defined case patients as children fulfilling the criteria for clinical deterioration, who were then matched with controls of the same age and hospital ward.

RESULTS

During the study period, 627 children were admitted, from whom we selected 79 case patients and 79 controls. For a PEWS-RL of ≥3, sensitivity was 96.2%, and specificity was 87.3% for identifying patients at risk for clinical deterioration. A total PEWS-RL of ≥3 was associated with a substantially increased risk of clinical deterioration (odds ratio 129.3; 95% confidence interval 38.8-431.6; P <.005).

CONCLUSIONS

This study reveals that the PEWS-RL, a simple score based on vital signs, mental status, and presence of respiratory distress, was feasible to implement in a resource-limited setting and was able to identify children at risk for clinical deterioration.

Predicting Postoperative Physiologic Decline After Surgery

BACKGROUND

Projecting postoperative recovery in pediatric surgical patients is challenging. We assessed how the patients' number of complex chronic conditions (CCCs) and chronic medications interacted with active health issues to influence the likelihood of postoperative physiologic decline (PoPD).

METHODS

A prospective study of 3295 patients undergoing elective surgery at a freestanding children's hospital. During preoperative clinical evaluation, active health problems, CCCs, and medications were documented. PoPD (compromise of cardiovascular, respiratory, and/or neurologic systems) was measured prospectively every 4 hours by inpatient nurses. PoPD odds were estimated with multivariable logistic regression. Classification and regression tree analysis distinguished children with the highest and lowest likelihood of PoPD.

RESULTS

Median age at surgery was 8 years (interquartile range: 2-15); 2336 (70.9%) patients had a CCC; and 241 (7.3%) used ≥11 home medications. During preoperative evaluation, 1556 (47.2%) patients had ≥1 active health problem. After surgery, 882 (26.8%) experienced PoPD. The adjusted odds of PoPD were 1.2 (95% confidence interval [CI]: 1.0-1.4) for presence versus absence of an active health problem; 1.4 (95% CI: 1.0-1.9) for ≥11 vs 0 home medications; and 2.2 (95% CI: 1.7-2.9) for ≥3 vs 0 CCCs. In classification and regression tree analysis, the lowest rate of PoPD (8.6%) occurred in children without an active health problem at the preoperative evaluation; the highest rate (57.2%) occurred in children with a CCC who used ≥11 home medications.

CONCLUSIONS

Greater than 1 in 4 pediatric patients undergoing elective surgery experienced PoPD. Combinations of active health problems at preoperative evaluation, polypharmacy, and multimorbidity distinguished patients with a low versus high risk of PoPD.

Science and health for all children with cancer

Each year ~429,000 children and adolescents aged 0 to 19 years are expected to develop cancer. Five-year survival rates exceed 80% for the 45,000 children with cancer in high-income countries (HICs) but are less than 30% for the 384,000 children in lower-middle-income countries (LMICs). Improved survival rates in HICs have been achieved through multidisciplinary care and research, with treatment regimens using mostly generic medicines and optimized risk stratification. Children’s outcomes in LMICs can be improved through global collaborative partnerships that help local leaders adapt effective treatments to local resources and clinical needs, as well as address common problems such as delayed diagnosis and treatment abandonment. Together, these approaches may bring within reach the global survival target recently set by the World Health Organization: 60% survival for all children with cancer by 2030.

Nested case-control study of multiple serological indexes and Brighton pediatric early warming score in predicting death of children with sepsis

BACKGROUND

Currently, it is difficult to predict the complications of children at the early stage of sepsis. Brighton pediatric early warning score (PEWS) is a disease risk assessment system that is simple and easy to operate, which has good sensitivity and specificity in disease recognition among children. Because detection indicators vary widely in children, a single indicator is difficult to assess the post-treatment status of children with sepsis.

AIM

To investigate the relationship between serological markers, Brighton PEWS, and death in children with sepsis after treatment.

METHODS

A total of 205 children diagnosed with sepsis at our hospital were enrolled. The baseline data, serum scores, and PEWS scores were recorded. In the nested case-control study, children who died during the study period were included in an observation group. According to the matching principle, the children who were not dead in the same cohort were included in a control group. The influencing factors of death in children with sepsis after treatment and the value of each evaluation index in predicting the prognosis of children were analyzed.

RESULTS

A total of 96 children were enrolled in the study, including 48 each in the observation group and the control group. Multivariate logistic regression analysis indicated that antibacterial treatments within 1 h (P = 0.017), shock (P = 0.044), multiple organ dysfunction syndrome (MODS) (P = 0.027), serum procalcitonin (PCT) (P = 0.047), serum albumin (ALB) (P = 0.024), and PEWS (P = 0.012) were independent risk factors for the death of children with sepsis. The area under the curve of the combination of ALB, PCT, and PEWS to predict the death in children with sepsis was the highest (0.908).

CONCLUSION

Antibacterial treatments within 1 h, shock, MODS, PCT, ALB, and PEWS are independent risk factors for the death of children with sepsis. The predictive accuracy of the combination of PCT, ALB, and PEWS for the prognosis of children with sepsis is the best.

Critical Care Management: Sepsis and Disseminated and Local Infections

Local and systemic infections are a significant cause of morbidity and mortality among immunocompromised children, including but not limited to patients with hematologic and solid malignancies, congenital or acquired immunodeficiencies, or hematopoietic cell or solid organ transplantation patients. Progression to septic shock can be rapid and profound and thus requires specific diagnostic and treatment approaches. This chapter will discuss the diagnosis and the initial hemodynamic management strategies of septic shock in immunocompromised children, including strategies to improve oxygen delivery, reduce metabolic demand, and monitor hemodynamic response to resuscitation. This chapter also discusses strategies to reverse septic shock pathobiology, including the use of both empiric and targeted anti-infective strategies and pharmacologic and cell therapy-based immunomodulation. Specific consideration is also paid to the management of high-risk subpopulations and the care of septic shock patients with resolving injury.

Pediatric Early Warning Systems aid in triage to intermediate versus intensive care for pediatric oncology patients in resource-limited hospitals

Pediatric oncology patients hospitalized in resource-limited settings are at high risk for clinical deterioration resulting in mortality. Intermediate care units (IMCUs) provide a cost-effective alternative to pediatric intensive care units (PICUs). Inappropriate IMCU triage, however, can lead to poor outcomes and suboptimal resource utilization. In this study, we sought to characterize patients with clinical deterioration requiring unplanned transfer to the IMCU in a resource-limited pediatric oncology hospital. Patients requiring subsequent early PICU transfer had longer PICU length of stay. PEWS results prior to IMCU transfer were higher in patients requiring early PICU transfer, suggesting PEWS can aid in triage between IMCU and PICU care.

Scoping Review of Pediatric Early Warning Systems (PEWS) in Resource-Limited and Humanitarian Settings

Pediatric Early Warning Systems (PEWS) aim to identify hospitalized children at increased risk of deterioration by assigning a score based on vital signs and clinical status and guiding interventions using a response algorithm to improve outcomes. When implemented with quality improvement methodology, these systems have been shown to be effective in high-resource settings and have the potential to improve the care of children in humanitarian and resource-limited settings (RLS). The purpose of this review is to summarize the current evidence for use of PEWS in RLS and identify areas for further research. A review of the current PEWS literature in RLS was performed using Web of Science, PubMed, Scopus, Cumulative Index of Nursing and Allied Health Literature (CINAHL), EMBASE, Portal Regional da BVS, and TRIP Database. While there is limited research available on this topic, eight studies on the use of PEWS, or a PEWS score in a pediatric population in low- or middle-income countries were identified. Two studies assessed the clinical effect of implementation of PEWS; one reported a reduction in clinical deterioration events and the other a reduction in mortality. The remaining studies assessed the association of a PEWS score with signs of clinical deterioration or mortality without a response algorithm. Further research on the impact of PEWS implementation on inpatient care and outcomes in RLS is needed.