Impact of PEWS on Perceived Quality of Care During Deterioration in Children With Cancer Hospitalized in Different Resource-Settings

Connecting Clinical Capacity and Intervention Sustainability in Resource-Variable Pediatric Oncology Centers in Latin America

Clinical capacity for sustainability, or the clinical resources needed to sustain an evidence-based practice, represent proximal determinants that contribute to intervention sustainment. We examine the relationship between clinical capacity for sustainability and sustainment of PEWS, an evidence-based intervention to improve outcomes for pediatric oncology patients in resource-variable hospitals. We conducted a cross-sectional survey among Latin American pediatric oncology centers participating in Proyecto Escala de Valoración de Alerta Temprana (EVAT), an improvement collaborative to implement Pediatric Early Warning Systems (PEWS). Hospitals were eligible if they had completed PEWS implementation. Clinicians were eligible to participate if they were involved in PEWS implementation or used PEWS in clinical work. The Spanish language survey consisted of 56 close and open-ended questions about the respondent, hospital, participants' assessment of clinical capacity to sustain PEWS using the clinical sustainability assessment tool (CSAT), and perceptions about PEWS and its use as an intervention. Results were analyzed using a multi-level modeling approach to examine the relationship between individual, hospital, intervention, and clinical capacity determinants to PEWS sustainment. A total of 797 responses from 37 centers in 13 countries were included in the analysis. Eighty-seven percent of participants reported PEWS sustainment. After controlling for individual, hospital, and intervention factors, clinical capacity was significantly associated with PEWS sustainment (OR 3.27, p < .01). Marginal effects from the final model indicate that an increasing capacity score has a positive influence (11% for every additional CSAT point) of predicting PEWS sustainment. PEWS is a sustainable intervention and clinical capacity to sustain PEWS contributes meaningfully to PEWS sustainment.

Sustainability determinants of an intervention to identify clinical deterioration and improve childhood cancer survival in Latin American hospitals: the INSPIRE study protocol

BACKGROUND

More than 90% of children with cancer live in low-resourced settings, where survival is only 20%. Sustainable evidence-based (EB) interventions yielding ongoing beneficial patient outcomes are critical to improve childhood cancer survival. A better understanding of factors promoting intervention sustainability in these settings is urgently needed. The aim of this study is to provide an empirical understanding of how clinical capacity for sustainability, or the resources needed to sustain an intervention, impacts the sustainment of Pediatric Early Warning System (PEWS), an EB intervention that improves pediatric oncology outcomes in low-resource hospitals by detecting clinical deterioration and preventing the need for more intense treatment.

METHODS

We will conduct a prospective, longitudinal study of approximately 100 resource-variable hospitals implementing and sustaining PEWS participating in Proyecto EVAT, a quality improvement collaborative of Latin American pediatric oncology centers. Aim 1: We will evaluate how clinical capacity for sustainability changes over time through 5 to 9 prospective measurements of capacity via survey of clinical staff using PEWS (approximately n = 13 per center) during the phases of PEWS adoption, implementation, and sustainability using the Clinical Sustainability Assessment Tool (CSAT). Aim 2: We will determine the relationship between capacity and a) PEWS sustainment and b) clinical deterioration mortality among pediatric oncology patients at centers sustaining PEWS for 2 to 10 years using chart review and an existing patient outcomes registry. Aim 3: We will develop novel strategies to promote sustainability by gaining a deeper understanding of perceived challenges to building capacity and PEWS sustainment. In combination with quantitative outcomes, we will conduct 24 focus groups with staff (doctors, nurses, and administrators) from hospitals with both high (n = 4) and low capacity (n = 4). We will then use implementation mapping to generate theoretically driven, empirically-supported sustainability strategies.

DISCUSSION

This study will advance implementation science by providing a theoretically driven, foundational understanding of factors that predict sustainability among a large, diverse cohort of hospitals. We will then use this knowledge to develop sustainability evidence-informed strategies that optimize capacity and promote long-term sustainment of PEWS and improvements in patient outcomes, thus promoting equity in childhood cancer care globally.

Effect of paediatric early warning systems (PEWS) implementation on clinical deterioration event mortality among children with cancer in resource-limited hospitals in Latin America: a prospective, multicentre cohort study

BACKGROUND

Paediatric early warning systems (PEWS) aid in the early identification of clinical deterioration events in children admitted to hospital. We aimed to investigate the effect of PEWS implementation on mortality due to clinical deterioration in children with cancer in 32 resource-limited hospitals across Latin America.

METHODS

Proyecto Escala de Valoración de Alerta Temprana (Proyecto EVAT) is a quality improvement collaborative to implement PEWS in hospitals providing childhood cancer care. In this prospective, multicentre cohort study, centres joining Proyecto EVAT and completing PEWS implementation between April 1, 2017, and May 31, 2021, prospectively tracked clinical deterioration events and monthly inpatient-days in children admitted to hospital with cancer. De-identified registry data reported between April 17, 2017, and Nov 30, 2021, from all hospitals were included in analyses; children with limitations on escalation of care were excluded. The primary outcome was clinical deterioration event mortality. Incidence rate ratios (IRRs) were used to compare clinical deterioration event mortality before and after PEWS implementation; multivariable analyses assessed the correlation between clinical deterioration event mortality and centre characteristics.

FINDINGS

Between April 1, 2017, and May 31, 2021, 32 paediatric oncology centres from 11 countries in Latin America successfully implemented PEWS through Proyecto EVAT; these centres documented 2020 clinical deterioration events in 1651 patients over 556 400 inpatient-days. Overall clinical deterioration event mortality was 32·9% (664 of 2020 events). The median age of patients with clinical deterioration events was 8·5 years (IQR 3·9-13·2), and 1095 (54·2%) of 2020 clinical deterioration events were reported in male patients; data on race or ethnicity were not collected. Data were reported per centre for a median of 12 months (IQR 10-13) before PEWS implementation and 18 months (16-18) after PEWS implementation. The mortality rate due to a clinical deterioration event was 1·33 events per 1000 patient-days before PEWS implementation and 1·09 events per 1000 patient-days after PEWS implementation (IRR 0·82 [95% CI 0·69-0·97]; p=0·021). In the multivariable analysis of centre characteristics, higher clinical deterioration event mortality rates before PEWS implementation (IRR 1·32 [95% CI 1·22-1·43]; p<0·0001), being a teaching hospital (1·18 [1·09-1·27]; p<0·0001), not having a separate paediatric haematology-oncology unit (1·38 [1·21-1·57]; p<0·0001), and having fewer PEWS omissions (0·95 [0·92-0·99]; p=0·0091) were associated with a greater reduction in clinical deterioration event mortality after PEWS implementation; no association was found with country income level (IRR 0·86 [95% CI 0·68-1·09]; p=0·22) or clinical deterioration event rates before PEWS implementation (1·04 [0·97-1·12]; p=0·29).

INTERPRETATION

PEWS implementation was associated with reduced clinical deterioration event mortality in paediatric patients with cancer across 32 resource-limited hospitals in Latin America. These data support the use of PEWS as an effective evidence-based intervention to reduce disparities in global survival for children with cancer.

FUNDING

American Lebanese Syrian Associated Charities, US National Institutes of Health, and Conquer Cancer Foundation.

TRANSLATIONS

For the Spanish and Portuguese translations of the abstract see Supplementary Materials section.

Stages of change: Strategies to promote use of a Pediatric Early Warning System in resource-limited pediatric oncology centers

BACKGROUND

Pediatric Early Warning Systems (PEWS) assist early detection of clinical deterioration in hospitalized children with cancer. Relevant to successful PEWS implementation, the "stages of change" model characterizes stakeholder support for PEWS based on willingness and effort to adopt the new practice.

METHODS

At five resource-limited pediatric oncology centers in Latin America, semi-structured interviews were conducted with 71 hospital staff involved in PEWS implementation. Purposive sampling was used to select centers requiring variable time to complete PEWS implementation, with low-barrier centers (3-4 months) and high-barrier centers (10-11 months). Interviews were conducted in Spanish, professionally transcribed, and translated into English. Thematic content analysis explored "stage of change" with constant comparative analysis across stakeholder types and study sites.

RESULTS

Participants identified six interventions (training, incentives, participation, evidence, persuasion, and modeling) and two policies (environmental planning and mandates) as effective strategies used by implementation leaders to promote stakeholder progression through stages of change. Key approaches involved presentation of evidence demonstrating PEWS effectiveness, persuasion and incentives addressing specific stakeholder interests, enthusiastic individuals serving as models for others, and policies enforced by hospital directors facilitating habitual PEWS use. Effective engagement targeted hospital directors during early implementation phases to provide programmatic legitimacy for clinical staff.

CONCLUSION

This study identifies strategies to promote adoption and maintained use of PEWS, highlighting the importance of tailoring implementation strategies to the motivations of each stakeholder type. These findings can guide efforts to implement PEWS and other evidence-based practices that improve childhood cancer outcomes in resource-limited hospitals.

Model for regional collaboration: Successful strategy to implement a pediatric early warning system in 36 pediatric oncology centers in Latin America

BACKGROUND

Pediatric early warning systems (PEWS) aid in the early identification of deterioration in hospitalized children with cancer; however, they are under-used in resource-limited settings. The authors use the knowledge-to-action framework to describe the implementation strategy for Proyecto Escala de Valoracion de Alerta Temprana (EVAT), a multicenter quality-improvement collaborative, to scale-up PEWS in pediatric oncology centers in Latin America.

METHODS

Proyecto EVAT mentored participating centers through an adaptable implementation strategy to: (1) monitor clinical deterioration in children with cancer, (2) contextually adapt PEWS, (3) assess barriers to using PEWS, (4) pilot and implement PEWS, (5) monitor the use of PEWS, (6) evaluate outcomes, and (7) sustain PEWS. The implementation outcomes assessed included the quality of PEWS use, the time required for implementation, and global program impact.

RESULTS

From April 2017 to October 2021, 36 diverse Proyecto EVAT hospitals from 13 countries in Latin America collectively managing more than 4100 annual new pediatric cancer diagnoses successfully implemented PEWS. The time to complete all program phases varied among centers, averaging 7 months (range, 3-13 months) from PEWS pilot to implementation completion. All centers ultimately implemented PEWS and maintained high-quality PEWS use for up to 18 months after implementation. Across the 36 centers, more than 11,100 clinicians were trained in PEWS, and more than 41,000 pediatric hospital admissions had PEWS used in their care.

CONCLUSIONS

Evidence-based interventions like PEWS can be successfully scaled-up regionally basis using a systematic approach that includes a collaborative network, an adaptable implementation strategy, and regional mentorship. Lessons learned can guide future programs to promote the widespread adoption of effective interventions and reduce global disparities in childhood cancer outcomes.

LAY SUMMARY

Pediatric early warning systems (PEWS) are clinical tools used to identify deterioration in hospitalized children with cancer; however, implementation challenges limit their use in resource-limited settings. Proyecto EVAT is a multicenter quality-improvement collaborative to implement PEWS in 36 pediatric oncology centers in Latin America. This is the first multicenter, multinational study reporting a successful implementation strategy (Proyecto EVAT) to regionally scale-up PEWS. The lessons learned from Proyecto EVAT can inform future programs to promote the adoption of clinical interventions to globally improve childhood cancer outcomes.

Multilevel impacts of a pediatric early warning system in resource-limited pediatric oncology hospitals

Background

Pediatric Early Warning Systems (PEWS) reduce clinical deterioration, improve interdisciplinary communication, and provide cost savings; however, little is known about how these impacts are achieved or related. This study evaluates the multi-level impacts of PEWS in resource-limited pediatric oncology centers.

Methods

We conducted 71 semi-structured interviews including physicians (45%), nurses (45%), and administrators (10%) from 5 resource-limited pediatric oncology centers in 4 Latin American countries. Interviews were conducted in Spanish, transcribed, and translated into English. A code book was developed using a priori and inductively derived codes. Transcripts were independently coded by 2 coders, achieving a kappa of 0.8-0.9. Thematic content analysis explored perceived impacts of PEWS at the level of the patient, clinician, healthcare team, and institution.

Results

PEWS improved the quality of attention for patients, reducing morbidity and mortality. Clinicians felt more knowledgeable, confident, and empowered providing patient care, resulting in greater job satisfaction. PEWS affected team dynamics by improving interdisciplinary (ward and intensive care unit) and interprofessional (physicians and nurses) relationships and communication. This ultimately led to institutional culture change with emphasis on patient safety, collaboration with other centers, and receipt of institutional awards. Together, these impacts led to hospital-wide support of ongoing PEWS use.

Conclusions

In resource-limited hospitals, PEWS use results in multi-level positive impacts on patients, clinicians, teams, and institutions, creating a feedback loop that further supports ongoing PEWS use. These findings can guide advocacy for PEWS to various stakeholders, improve PEWS effectiveness, and inform assessment of other interventions to improve childhood cancer outcomes.

Pediatric Early Warning Systems (PEWS) improve provider-family communication from the provider perspective in pediatric cancer patients experiencing clinical deterioration

BACKGROUND

Communication between providers and patients' families is an integral part of clinical care. Family concern is a validated component of Pediatric Early Warning Systems (PEWS); however, little is known about the impact of PEWS on provider-family communication.

METHODS

Semi-structured interviews were conducted with 83 ward and Pediatric Intensive Care Unit (PICU) providers involved in the care of patients with deterioration at two pediatric oncology hospitals of different resource levels: St. Jude Children's Research Hospital (n = 42) in the United States and Unidad Nacional de Oncología Pediátrica (UNOP, n = 41) in Guatemala. Interviews were conducted in the participants' native language (English or Spanish), transcribed, and translated into English. Transcripts were coded by two researchers and analyzed for thematic content surrounding family communication and concern.

RESULTS

All participants recognized patients' families as a valuable part of the care team, particularly during events requiring escalation of care. Perceived barriers to communication included limited time spent at the bedside, and, at UNOP, language and literacy challenges which occasionally limited providers' ability to assess family concern and involve families in patient care. Despite these barriers, providers perceived PEWS improved communication by facilitating more interaction with families, allowing for relationship-building, anticipatory guidance, and destigmatization of the PICU. PEWS assessments also allowed families to contribute to identification of deterioration.

CONCLUSIONS

PEWS improve the quality of communication between providers and families by providing more opportunities for interaction, building relationships, and trust. These findings further support the use of PEWS in the care of children with cancer in hospitals of all resource-levels.

Impact of an electronic alert system for pediatric sepsis screening a tertiary hospital experience

This study aimed to assess the potential impact of implementing an electronic alert system (EAS) for systemic inflammatory syndrome (SIRS) and sepsis in pediatric patients mortality. This retrospective study had a pre and post design. We enrolled patients aged ≤ 14 years who were diagnosed with sepsis/severe sepsis upon admission to the pediatric intensive care unit (PICU) of our tertiary hospital from January 2014 to December 2018. We implemented an EAS for the patients with SIRS/sepsis. The patients who met the inclusion criteria pre-EAS implementation comprised the control group, and the group post-EAS implementation was the experimental group. Mortality was the primary outcome, while length of stay (LOS) and mechanical ventilation in the first hour were the secondary outcomes. Of the 308 enrolled patients, 147 were in the pre-EAS group and 161 in the post-EAS group. In terms of mortality, 44 patients in the pre-EAS group and 28 in the post-EAS group died (p 0.011). The average LOS in the PICU was 7.9 days for the pre-EAS group and 6.8 days for the post-EAS group (p 0.442). Considering the EAS initiation time as the “zero time”, early recognition of SIRS and sepsis via the EAS led to faster treatment interventions in post-EAS group, which included fluid boluses with median (25th, 75th percentile) time of 107 (37, 218) min vs. 30 (11,112) min, p < 0.001) and time to initiate antimicrobial therapy median (25th, 75th percentile) of 170.5 (66,320) min vs. 131 (53,279) min, p 0.042). The difference in mechanical ventilation in the first hour of admission was not significant between the groups (25.17% vs. 24.22%, p 0.895). The implementation of the EAS resulted in a statistically significant reduction in the mortality rate among the patients admitted to the PICU in our study. An EAS can play an important role in saving lives and subsequent reduction in healthcare costs. Further enhancement of systematic screening is therefore highly recommended to improve the prognosis of pediatric SIRS and sepsis. The implementation of the EAS, warrants further validation in multicenter or national studies.

Utilizing Multilingual Methods and Rapid Analysis for Global Qualitative Research During a Pandemic

Historically, qualitative research has complemented quantitative biologic and epidemiologic studies to provide a more complete understanding of pandemics. The COVID-19 pandemic has generated unique and novel challenges for qualitative researchers, who have embraced creative solutions including virtual focus groups and rapid analyses to continue their work. We present our experience conducting a multilingual global qualitative study of healthcare resilience among teams of pediatric oncology professionals during the COVID-19 pandemic. We provide an in-depth description of our methodology and an analysis of factors we believe contributed to our study’s success including our use of technology, engagement of a large multilingual team, global partnerships, and framework-based rapid analysis. We hope these techniques may be useful to qualitative researchers conducting studies during the current pandemic, as well as for all pediatric oncology studies including multiple languages or geographically disparate subjects.

Challenges to sustainability of pediatric early warning systems (PEWS) in low-resource hospitals in Latin America

Background

Sustainability, or continued use of evidence-based interventions for long-term patient benefit, is the least studied aspect of implementation science. In this study, we evaluate sustainability of a Pediatric Early Warning System (PEWS), an evidence-based intervention to improve early identification of clinical deterioration in hospitalized children, in low-resource settings using the Clinical Capacity for Sustainability Framework (CCS).

Methods

We conducted a secondary analysis of a qualitative study to identify barriers and enablers to PEWS implementation. Semi-structured interviews with PEWS implementation leaders and hospital directors at 5 Latin American pediatric oncology centers sustaining PEWS were conducted virtually in Spanish from June to August 2020. Interviews were recorded, professionally transcribed, and translated into English. Exploratory thematic content analysis yielded staff perceptions on PEWS sustainability. Coded segments were analyzed to identify participant perception about the current state and importance of sustaining PEWS, as well as sustainability successes and challenges. Identified sustainability determinants were mapped to the CCS to evaluate its applicability.

Results

We interviewed 71 staff including physicians (45%), nurses (45%), and administrators (10%). Participants emphasized the importance of sustaining PEWS for continued patient benefits. Identified sustainability determinants included supportive leadership encouraging ongoing interest in PEWS, beneficial patient outcomes enhancing perceived value of PEWS, integrating PEWS into the routine of patient care, ongoing staff turnover creating training challenges, adequate material resources to promote PEWS use, and the COVID-19 pandemic. While most identified factors mapped to the CCS, COVID-19 emerged as an additional external sustainability challenge. Together, these challenges resulted in multiple impacts on PEWS sustainment, ranging from a small reduction in PEWS quality to complete disruption of PEWS use and subsequent loss of benefits to patients. Participants described several innovative strategies to address identified challenges and promote PEWS sustainability.

Conclusion

This study describes clinician perspectives on sustainable implementation of evidence-based interventions in low-resource settings, including sustainability determinants and potential sustainability strategies. Identified factors mapped well to the CCS, however, external factors, such as the COVID pandemic, may additionally impact sustainability. This work highlights an urgent need for theoretically-driven, empirically-informed strategies to support sustainable implementation of evidence-based interventions in settings of all resource-levels.