Cost-benefit analysis of implementing a pediatric early warning system at a pediatric oncology hospital in a low-middle income country

Advanced prescription of injectable anticancer drugs: Safety assessment in a European Comprehensive Cancer Centre using the risk matrix approach

AIMS

The purpose of this work was to assess failures in the advanced prescription of parenteral anticancer agents in an adult day oncology care unit with more than 100 patients per day.

METHODS

An a priori descriptive analysis was carried out by using the risk matrix approach. After defining the scope in a multidisciplinary meeting, we determined at each step the failure modes (FMs), their effects (E) and their associated causes (C). A severity score (S) was assigned to all effects and a probability of occurrence (O) to all causes. These S and O indicators, were used to obtain a criticality index (CI) matrix. We assessed the risk control (RC) of each failure in order to define a residual criticality index (rCI) matrix.

RESULTS

During risk analysis, 14 FMs were detected, and 61 scenarios were identified considering all possible effects and causes. Nine situations (15%) were highlighted with the maximum CI, 18 (30%) with a medium CI, and 34 (55%) with a negligible CI. Nevertheless, among all these critical situations, only three (5%) had an rCI to process (i.e., missed dose adjustment, multiple prescriptions and abnormal biology data); the others required monitoring only. Clinicians' and pharmacists' knowledge of these critical situations enables them to manage the associated risks.

CONCLUSIONS

Advanced prescription of injectable anticancer drugs appears to be a safe practice for patients when combined with risk management. The major risks identified concerned missed dose adjustment, prescription duplication and lack of consideration for abnormal biology data.

Addressing the gap in health economics data to support national cancer control plans in low- and middle-income countries: The Childhood Cancers Budgeting Rapidly to Incorporate Disadvantaged Groups for Equity (CC-BRIDGE) tool

BACKGROUND

National cancer control plans (NCCPs) are complex public health programs that incorporate evidence-based cancer control strategies to improve health outcomes for all individuals in a country. Given the scope of NCCPs, small and vulnerable populations, such as patients with childhood cancer, are often missed. To support planning efforts, a rapid, modifiable tool was developed that estimates a context-specific national budget to fund pediatric cancer programs, provides 5-year scale-up scenarios, and calculates annual cost-effectiveness.

METHODS

The tool was codeveloped by teams of policymakers, clinicians, and public health advocates in Zimbabwe, Zambia, and Uganda. The 11 costing categories included real-world data, modeled data, and data from the literature. A base-case and three 5-year scale-up scenarios were created using modifiable inputs. The cost-effectiveness of the disability-adjusted life years averted was calculated. Results were compared with each country's projected gross domestic product per capita for 2022 through 2026.

RESULTS

The number of patients/total budget for year 1 was 250/$1,109,366 for Zimbabwe, 280/$1,207,555 for Zambia, and 1000/$2,277,397 for Uganda. In year 5, these values were assumed to increase to 398/$5,545,445, 446/$4,926,150, and 1594/$9,059,331, respectively. Base-case cost per disability-adjusted life year averted/ratio to gross domestic product per capita for year 1, assuming 20% survival, was: $807/0.5 for Zimbabwe, $785/0.7 for Zambia, and $420/0.5 for Uganda.

CONCLUSIONS

This costing tool provided a framework to forecast a budget for childhood-specific cancer services. By leveraging minimal primary data collection with existing secondary data, local teams obtained rapid results, ensuring that childhood cancer budgeting is not neglected once in every 5 to 6 years of planning processes.

Connecting Clinical Capacity and Intervention Sustainability in Resource-Variable Pediatric Oncology Centers in Latin America

Clinical capacity for sustainability, or the clinical resources needed to sustain an evidence-based practice, represent proximal determinants that contribute to intervention sustainment. We examine the relationship between clinical capacity for sustainability and sustainment of PEWS, an evidence-based intervention to improve outcomes for pediatric oncology patients in resource-variable hospitals. We conducted a cross-sectional survey among Latin American pediatric oncology centers participating in Proyecto Escala de Valoración de Alerta Temprana (EVAT), an improvement collaborative to implement Pediatric Early Warning Systems (PEWS). Hospitals were eligible if they had completed PEWS implementation. Clinicians were eligible to participate if they were involved in PEWS implementation or used PEWS in clinical work. The Spanish language survey consisted of 56 close and open-ended questions about the respondent, hospital, participants' assessment of clinical capacity to sustain PEWS using the clinical sustainability assessment tool (CSAT), and perceptions about PEWS and its use as an intervention. Results were analyzed using a multi-level modeling approach to examine the relationship between individual, hospital, intervention, and clinical capacity determinants to PEWS sustainment. A total of 797 responses from 37 centers in 13 countries were included in the analysis. Eighty-seven percent of participants reported PEWS sustainment. After controlling for individual, hospital, and intervention factors, clinical capacity was significantly associated with PEWS sustainment (OR 3.27, p < .01). Marginal effects from the final model indicate that an increasing capacity score has a positive influence (11% for every additional CSAT point) of predicting PEWS sustainment. PEWS is a sustainable intervention and clinical capacity to sustain PEWS contributes meaningfully to PEWS sustainment.

Determining the cost and cost-effectiveness of childhood cancer treatment in Haiti

Haiti is a low-income country with one of the lowest human development index rankings in the world. Its childhood cancer services are provided by a single hospital with the only dedicated paediatric oncology department in the country. Our objective was to assess the cost and cost-effectiveness of all types of childhood cancer in Haiti to help prioritise investments and to support national cancer control planning. All costing data were collected from the year 2017 or 2018 hospital records. Costs were classified into 11 cost categories, and the proportion of the overall budget represented by each was calculated and converted from Haitian Gourde to United States dollars. The 5-year survival rate was retrieved from hospital records and used to calculate the cost-effectiveness of disability-adjusted life year (DALY) averted, using a healthcare costing perspective. Additional sensitivity analyses were conducted accounting for late-effect morbidity and early mortality and discounting rates of 0%, 3% and 6%. The annual cost of operating a paediatric oncology unit in Haiti treating 74 patients with newly diagnosed cancer was $803,184 overall or $10,854 per patient. The largest cost category was pharmacy, constituting 25% of the overall budget, followed by medical personnel (20%) and administration (12%). The cost per DALY averted in the base-case scenario was $1,128, which is 76% of the gross domestic product per capita, demonstrating that treating children with cancer in Haiti is very cost-effective according to the World Health Organisation Choosing Interventions that are Cost-Effective (WHO-CHOICE) threshold. In the most conservative scenario, the cost per DALY averted was cost-effective by WHO-CHOICE criteria. Our data will add to the growing body of literature illustrating a positive return on investment associated with diagnosing and treating children with cancer in even the most resource-limited environments. We anticipate that these data will aid local stakeholders and policymakers when identifying cancer control priorities and making budgetary decisions.

Sustainability determinants of an intervention to identify clinical deterioration and improve childhood cancer survival in Latin American hospitals: the INSPIRE study protocol

BACKGROUND

More than 90% of children with cancer live in low-resourced settings, where survival is only 20%. Sustainable evidence-based (EB) interventions yielding ongoing beneficial patient outcomes are critical to improve childhood cancer survival. A better understanding of factors promoting intervention sustainability in these settings is urgently needed. The aim of this study is to provide an empirical understanding of how clinical capacity for sustainability, or the resources needed to sustain an intervention, impacts the sustainment of Pediatric Early Warning System (PEWS), an EB intervention that improves pediatric oncology outcomes in low-resource hospitals by detecting clinical deterioration and preventing the need for more intense treatment.

METHODS

We will conduct a prospective, longitudinal study of approximately 100 resource-variable hospitals implementing and sustaining PEWS participating in Proyecto EVAT, a quality improvement collaborative of Latin American pediatric oncology centers. Aim 1: We will evaluate how clinical capacity for sustainability changes over time through 5 to 9 prospective measurements of capacity via survey of clinical staff using PEWS (approximately n = 13 per center) during the phases of PEWS adoption, implementation, and sustainability using the Clinical Sustainability Assessment Tool (CSAT). Aim 2: We will determine the relationship between capacity and a) PEWS sustainment and b) clinical deterioration mortality among pediatric oncology patients at centers sustaining PEWS for 2 to 10 years using chart review and an existing patient outcomes registry. Aim 3: We will develop novel strategies to promote sustainability by gaining a deeper understanding of perceived challenges to building capacity and PEWS sustainment. In combination with quantitative outcomes, we will conduct 24 focus groups with staff (doctors, nurses, and administrators) from hospitals with both high (n = 4) and low capacity (n = 4). We will then use implementation mapping to generate theoretically driven, empirically-supported sustainability strategies.

DISCUSSION

This study will advance implementation science by providing a theoretically driven, foundational understanding of factors that predict sustainability among a large, diverse cohort of hospitals. We will then use this knowledge to develop sustainability evidence-informed strategies that optimize capacity and promote long-term sustainment of PEWS and improvements in patient outcomes, thus promoting equity in childhood cancer care globally.

Treatment-related mortality in children with cancer in low-income and middle-income countries: a systematic review and meta-analysis

BACKGROUND

Approximately 90% of children with cancer live in low-income and middle-income countries (LMICs), where 5-year survival is lower than 20%. Treatment-related mortality in high-income countries is approximately 3-5%; however, in LMICs, treatment-related mortality has been reported in up to 45% of children with cancer. This study aimed to systematically explore the burden of treatment-related mortality in children with cancer in LMICs and to explore the association between country income level and treatment-related mortality.

METHODS

For this systematic review and meta-analysis we identified articles published between Jan 1, 2010, and June 22, 2021, describing treatment-related mortality in paediatric patients (aged 0-21 years) with cancer in LMICs. We searched PubMed, Trip, Web of Science, Embase, and the WHO Global Metric Index databases. The search was limited to full-text articles and excluded case reports (<10 patients) and haematopoietic stem-cell transplantation recipients. Two reviewers independently screened studies for eligibility, extracted data from included publications, and evaluated data quality. Random and mixed-effects models were used to estimate treatment-related mortality burden and trends. The Cochran-Q statistic was used to assess heterogeneity between studies. This study is registered on PROSPERO (CRD42021264849).

FINDINGS

Of 13 269 identified abstracts, 501 studies representing 68 351 paediatric patients with cancer were included. The treatment-related mortality estimate was 6·82% (95% CI 5·99-7·64), accounting for 30·9% of overall mortality (4437 of 14 358 deaths). Treatment-related mortality was inversely related to country income. Treatment-related mortality was 14·19% (95% CI 9·65-18·73) in low-income countries, 9·21% (7·93-10·49) in lower-middle-income countries, and 4·47% (3·42-5·53) in upper-middle-income countries (Cochran-Q 42·39, p<0·0001). In upper-middle-income countries, the incidence of treatment-related mortality decreased over time (slope -0·002, p=0·0028); however, outcomes remained unchanged in low-income (p=0·21) and lower-middle-income countries (p=0·16).

INTERPRETATION

Approximately one in 15 children receiving cancer treatment in LMICs die from treatment-related complications. Although treatment-related mortality has decreased in upper-middle-income countries over time, it remains unchanged in LMICs. There is an urgent need for targeted supportive care interventions to reduce global disparities in childhood cancer survival.

FUNDING

American Lebanese Syrian Associated Charities and National Cancer Institute.

Effect of paediatric early warning systems (PEWS) implementation on clinical deterioration event mortality among children with cancer in resource-limited hospitals in Latin America: a prospective, multicentre cohort study

BACKGROUND

Paediatric early warning systems (PEWS) aid in the early identification of clinical deterioration events in children admitted to hospital. We aimed to investigate the effect of PEWS implementation on mortality due to clinical deterioration in children with cancer in 32 resource-limited hospitals across Latin America.

METHODS

Proyecto Escala de Valoración de Alerta Temprana (Proyecto EVAT) is a quality improvement collaborative to implement PEWS in hospitals providing childhood cancer care. In this prospective, multicentre cohort study, centres joining Proyecto EVAT and completing PEWS implementation between April 1, 2017, and May 31, 2021, prospectively tracked clinical deterioration events and monthly inpatient-days in children admitted to hospital with cancer. De-identified registry data reported between April 17, 2017, and Nov 30, 2021, from all hospitals were included in analyses; children with limitations on escalation of care were excluded. The primary outcome was clinical deterioration event mortality. Incidence rate ratios (IRRs) were used to compare clinical deterioration event mortality before and after PEWS implementation; multivariable analyses assessed the correlation between clinical deterioration event mortality and centre characteristics.

FINDINGS

Between April 1, 2017, and May 31, 2021, 32 paediatric oncology centres from 11 countries in Latin America successfully implemented PEWS through Proyecto EVAT; these centres documented 2020 clinical deterioration events in 1651 patients over 556 400 inpatient-days. Overall clinical deterioration event mortality was 32·9% (664 of 2020 events). The median age of patients with clinical deterioration events was 8·5 years (IQR 3·9-13·2), and 1095 (54·2%) of 2020 clinical deterioration events were reported in male patients; data on race or ethnicity were not collected. Data were reported per centre for a median of 12 months (IQR 10-13) before PEWS implementation and 18 months (16-18) after PEWS implementation. The mortality rate due to a clinical deterioration event was 1·33 events per 1000 patient-days before PEWS implementation and 1·09 events per 1000 patient-days after PEWS implementation (IRR 0·82 [95% CI 0·69-0·97]; p=0·021). In the multivariable analysis of centre characteristics, higher clinical deterioration event mortality rates before PEWS implementation (IRR 1·32 [95% CI 1·22-1·43]; p<0·0001), being a teaching hospital (1·18 [1·09-1·27]; p<0·0001), not having a separate paediatric haematology-oncology unit (1·38 [1·21-1·57]; p<0·0001), and having fewer PEWS omissions (0·95 [0·92-0·99]; p=0·0091) were associated with a greater reduction in clinical deterioration event mortality after PEWS implementation; no association was found with country income level (IRR 0·86 [95% CI 0·68-1·09]; p=0·22) or clinical deterioration event rates before PEWS implementation (1·04 [0·97-1·12]; p=0·29).

INTERPRETATION

PEWS implementation was associated with reduced clinical deterioration event mortality in paediatric patients with cancer across 32 resource-limited hospitals in Latin America. These data support the use of PEWS as an effective evidence-based intervention to reduce disparities in global survival for children with cancer.

FUNDING

American Lebanese Syrian Associated Charities, US National Institutes of Health, and Conquer Cancer Foundation.

TRANSLATIONS

For the Spanish and Portuguese translations of the abstract see Supplementary Materials section.

Stages of change: Strategies to promote use of a Pediatric Early Warning System in resource-limited pediatric oncology centers

BACKGROUND

Pediatric Early Warning Systems (PEWS) assist early detection of clinical deterioration in hospitalized children with cancer. Relevant to successful PEWS implementation, the "stages of change" model characterizes stakeholder support for PEWS based on willingness and effort to adopt the new practice.

METHODS

At five resource-limited pediatric oncology centers in Latin America, semi-structured interviews were conducted with 71 hospital staff involved in PEWS implementation. Purposive sampling was used to select centers requiring variable time to complete PEWS implementation, with low-barrier centers (3-4 months) and high-barrier centers (10-11 months). Interviews were conducted in Spanish, professionally transcribed, and translated into English. Thematic content analysis explored "stage of change" with constant comparative analysis across stakeholder types and study sites.

RESULTS

Participants identified six interventions (training, incentives, participation, evidence, persuasion, and modeling) and two policies (environmental planning and mandates) as effective strategies used by implementation leaders to promote stakeholder progression through stages of change. Key approaches involved presentation of evidence demonstrating PEWS effectiveness, persuasion and incentives addressing specific stakeholder interests, enthusiastic individuals serving as models for others, and policies enforced by hospital directors facilitating habitual PEWS use. Effective engagement targeted hospital directors during early implementation phases to provide programmatic legitimacy for clinical staff.

CONCLUSION

This study identifies strategies to promote adoption and maintained use of PEWS, highlighting the importance of tailoring implementation strategies to the motivations of each stakeholder type. These findings can guide efforts to implement PEWS and other evidence-based practices that improve childhood cancer outcomes in resource-limited hospitals.

A Systematic Review of Health Economic Evaluations and Budget Impact Analyses to Inform Healthcare Decision-Making in Central America

BACKGROUND

Little is known about the quality, quantity and disease areas analysed by health economic research that inform healthcare decision-making in Central America. This study aimed to review the existing health economic evaluations (HEEs) and budget impact analyses (BIAs) evidence in Central America based on scope and reporting quality.

METHODS

HEEs and BIAs published from 2000 to April 2021 were searched in five electronic databases: PubMed, Embase, LILACS (Latin American and Caribbean Health Science Literature), EconLIT and OVID Global Health. Two reviewers assessed titles, abstracts and full texts of studies for eligibility. The quality appraisal for the reporting was based on La Torre and colleagues' version of the Drummond checklist and the ISPOR good practices for BIA. For each country, we correlated the number of studies by disease area with their respective burden of disease to identify under-researched health areas.

RESULTS

102 publications were eligible for this review. Ninety-four publications reported a HEE, six publications reported a BIA, and two studies reported both a HEE and a BIA. Costa Rica had the highest number of publications (n = 28, 27.5%), followed by Guatemala (n = 25, 24.5%). Cancer and respiratory infections were the most common types of disease studied. Diabetes mellitus, chronic kidney diseases, and mental disorders were under-researched relative to their disease burden in most of the countries. The overall mean quality reporting score for HEE and BIA studies were 71/119 points (60%) and 7/10 points (70%), respectively; however, these assessments were made on different scales.

CONCLUSION

In Central America, health economic research is sparse and is considered as suboptimal quality for reporting. The findings reported information useful to other low- and middle-income countries with similar advances in the application of economics to promote health policy decision-making.

Development and pilot testing of PROACTIVE: A pediatric onco-critical care capacity and quality assessment tool for resource-limited settings

BACKGROUND

Nearly 90% children with cancer reside in low- and middle-income countries, which face multiple challenges delivering high-quality pediatric onco-critical care (POCC). We recently identified POCC quality and capacity indicators for PROACTIVE (PediatRic Oncology cApaCity assessment Tool for IntensiVe carE), a tool that evaluates strengths and limitations in POCC services. This study describes pilot testing of PROACTIVE, development of center-specific reports, and identification of common POCC challenges.

METHODS

The original 119 consensus-derived PROACTIVE indicators were converted into 182 questions divided between 2 electronic surveys for intensivists and oncologists managing critically ill pediatric cancer patients. Alpha-testing was conducted to confirm face-validity with four pediatric intensivists. Eleven centers representing diverse geographic regions, income levels, and POCC services conducted beta-testing to evaluate usability, feasibility, and applicability of PROACTIVE. Centers' responses were scored and indicators with mean scores ≤75% in availability/performance were classified as common POCC challenges.

RESULTS

Alpha-testing ensured face-validity and beta-testing demonstrated feasibility and usability of PROACTIVE (October 2020-June 2021). Twenty-two surveys (response rate 99.4%) were used to develop center-specific reports. Adjustments to PROACTIVE were made based on focus group feedback and surveys, resulting in 200 questions. Aggregated data across centers identified common POCC challenges: (1) lack of pediatric intensivists, (2) absence of abstinence and withdrawal symptoms monitoring, (3) shortage of supportive care resources, and (4) limited POCC training for physicians and nurses.

CONCLUSIONS

PROACTIVE is a feasible and contextually appropriate tool to help clinicians and organizations identify challenges in POCC services across a wide range of resource-levels. Widespread use of PROACTIVE can help prioritize and develop tailored interventions to strengthen POCC services and outcomes globally.

Implementation costs of hospital-based computerised decision support systems: a systematic review

BACKGROUND

The importance of accurately costing implementation strategies is increasingly recognised within the field of implementation science. However, there is a lack of methodological guidance for costing implementation, particularly within digital health settings. This study reports on a systematic review of costing analyses conducted alongside implementation of hospital-based computerised decision support systems.

METHODS

PubMed, Embase, Scopus and CINAHL databases were searched between January 2010 and August 2021. Two reviewers independently screened and selected original research studies that were conducted in a hospital setting, examined the implementation of a computerised decision support systems and reported implementation costs. The Expert Recommendations for Implementing Change Framework was used to identify and categorise implementation strategies into clusters. A previously published costing framework was applied to describe the methods used to measure and value implementation costs. The reporting quality of included studies was assessed using the Consolidated Health Economic Evaluation Reporting Standards checklist.

RESULTS

Titles and abstracts of 1836 articles were screened, with nine articles eligible for inclusion in the review. Implementation costs were most frequently reported under the 'evaluative and iterative strategies' cluster, followed by 'provide interactive assistance'. Labour was the largest implementation-related cost in the included papers, irrespective of implementation strategy. Other reported costs included consumables, durable assets and physical space, which was mostly associated with stakeholder training. The methods used to cost implementation were often unclear. There was variation across studies in the overall quality of reporting.

CONCLUSIONS

A relatively small number of papers have described computerised decision support systems implementation costs, and the methods used to measure and value these costs were not well reported. Priorities for future research should include establishing consistent terminology and appropriate methods for estimating and reporting on implementation costs.

TRIAL REGISTRATION

The review protocol is registered with PROSPERO (ID: CRD42021272948).

Impact of hospital characteristics on implementation of a Pediatric Early Warning System in resource-limited cancer hospitals

Background

Pediatric Early Warning Systems (PEWS) aid in identification of deterioration in hospitalized children with cancer but are underutilized in resource-limited settings. Proyecto EVAT is a multicenter quality improvement (QI) collaborative in Latin America to implement PEWS. This study investigates the relationship between hospital characteristics and time required for PEWS implementation.

Methods

This convergent mixed-methods study included 23 Proyecto EVAT childhood cancer centers; 5 hospitals representing quick and slow implementers were selected for qualitative analysis. Semi-structured interviews were conducted with 71 stakeholders involved in PEWS implementation. Interviews were recorded, transcribed and translated to English, then coded using a priori and novel codes. Thematic content analysis explored the impact of hospital characteristics and QI experience on time required for PEWS implementation and was supplemented by quantitative analysis exploring the relationship between hospital characteristics and implementation time.

Results

In both quantitative and qualitative analysis, material and human resources to support PEWS significantly impacted time to implementation. Lack of resources produced various obstacles that extended time necessary for centers to achieve successful implementation. Hospital characteristics, such as funding structure and type, influenced PEWS implementation time by determining their resource-availability. Prior hospital or implementation leader experience with QI, however, helped facilitate implementation by assisting implementers predict and overcome resource-related challenges.

Conclusions

Hospital characteristics impact time required to implement PEWS in resource-limited childhood cancer centers; however, prior QI experience helps anticipate and adapt to resource challenges and more quickly implement PEWS. QI training should be a component of strategies to scale-up use of evidence-based interventions like PEWS in resource-limited settings.

Model for regional collaboration: Successful strategy to implement a pediatric early warning system in 36 pediatric oncology centers in Latin America

BACKGROUND

Pediatric early warning systems (PEWS) aid in the early identification of deterioration in hospitalized children with cancer; however, they are under-used in resource-limited settings. The authors use the knowledge-to-action framework to describe the implementation strategy for Proyecto Escala de Valoracion de Alerta Temprana (EVAT), a multicenter quality-improvement collaborative, to scale-up PEWS in pediatric oncology centers in Latin America.

METHODS

Proyecto EVAT mentored participating centers through an adaptable implementation strategy to: (1) monitor clinical deterioration in children with cancer, (2) contextually adapt PEWS, (3) assess barriers to using PEWS, (4) pilot and implement PEWS, (5) monitor the use of PEWS, (6) evaluate outcomes, and (7) sustain PEWS. The implementation outcomes assessed included the quality of PEWS use, the time required for implementation, and global program impact.

RESULTS

From April 2017 to October 2021, 36 diverse Proyecto EVAT hospitals from 13 countries in Latin America collectively managing more than 4100 annual new pediatric cancer diagnoses successfully implemented PEWS. The time to complete all program phases varied among centers, averaging 7 months (range, 3-13 months) from PEWS pilot to implementation completion. All centers ultimately implemented PEWS and maintained high-quality PEWS use for up to 18 months after implementation. Across the 36 centers, more than 11,100 clinicians were trained in PEWS, and more than 41,000 pediatric hospital admissions had PEWS used in their care.

CONCLUSIONS

Evidence-based interventions like PEWS can be successfully scaled-up regionally basis using a systematic approach that includes a collaborative network, an adaptable implementation strategy, and regional mentorship. Lessons learned can guide future programs to promote the widespread adoption of effective interventions and reduce global disparities in childhood cancer outcomes.

LAY SUMMARY

Pediatric early warning systems (PEWS) are clinical tools used to identify deterioration in hospitalized children with cancer; however, implementation challenges limit their use in resource-limited settings. Proyecto EVAT is a multicenter quality-improvement collaborative to implement PEWS in 36 pediatric oncology centers in Latin America. This is the first multicenter, multinational study reporting a successful implementation strategy (Proyecto EVAT) to regionally scale-up PEWS. The lessons learned from Proyecto EVAT can inform future programs to promote the adoption of clinical interventions to globally improve childhood cancer outcomes.

Multilevel impacts of a pediatric early warning system in resource-limited pediatric oncology hospitals

Background

Pediatric Early Warning Systems (PEWS) reduce clinical deterioration, improve interdisciplinary communication, and provide cost savings; however, little is known about how these impacts are achieved or related. This study evaluates the multi-level impacts of PEWS in resource-limited pediatric oncology centers.

Methods

We conducted 71 semi-structured interviews including physicians (45%), nurses (45%), and administrators (10%) from 5 resource-limited pediatric oncology centers in 4 Latin American countries. Interviews were conducted in Spanish, transcribed, and translated into English. A code book was developed using a priori and inductively derived codes. Transcripts were independently coded by 2 coders, achieving a kappa of 0.8-0.9. Thematic content analysis explored perceived impacts of PEWS at the level of the patient, clinician, healthcare team, and institution.

Results

PEWS improved the quality of attention for patients, reducing morbidity and mortality. Clinicians felt more knowledgeable, confident, and empowered providing patient care, resulting in greater job satisfaction. PEWS affected team dynamics by improving interdisciplinary (ward and intensive care unit) and interprofessional (physicians and nurses) relationships and communication. This ultimately led to institutional culture change with emphasis on patient safety, collaboration with other centers, and receipt of institutional awards. Together, these impacts led to hospital-wide support of ongoing PEWS use.

Conclusions

In resource-limited hospitals, PEWS use results in multi-level positive impacts on patients, clinicians, teams, and institutions, creating a feedback loop that further supports ongoing PEWS use. These findings can guide advocacy for PEWS to various stakeholders, improve PEWS effectiveness, and inform assessment of other interventions to improve childhood cancer outcomes.

Impact of an electronic alert system for pediatric sepsis screening a tertiary hospital experience

This study aimed to assess the potential impact of implementing an electronic alert system (EAS) for systemic inflammatory syndrome (SIRS) and sepsis in pediatric patients mortality. This retrospective study had a pre and post design. We enrolled patients aged ≤ 14 years who were diagnosed with sepsis/severe sepsis upon admission to the pediatric intensive care unit (PICU) of our tertiary hospital from January 2014 to December 2018. We implemented an EAS for the patients with SIRS/sepsis. The patients who met the inclusion criteria pre-EAS implementation comprised the control group, and the group post-EAS implementation was the experimental group. Mortality was the primary outcome, while length of stay (LOS) and mechanical ventilation in the first hour were the secondary outcomes. Of the 308 enrolled patients, 147 were in the pre-EAS group and 161 in the post-EAS group. In terms of mortality, 44 patients in the pre-EAS group and 28 in the post-EAS group died (p 0.011). The average LOS in the PICU was 7.9 days for the pre-EAS group and 6.8 days for the post-EAS group (p 0.442). Considering the EAS initiation time as the “zero time”, early recognition of SIRS and sepsis via the EAS led to faster treatment interventions in post-EAS group, which included fluid boluses with median (25th, 75th percentile) time of 107 (37, 218) min vs. 30 (11,112) min, p < 0.001) and time to initiate antimicrobial therapy median (25th, 75th percentile) of 170.5 (66,320) min vs. 131 (53,279) min, p 0.042). The difference in mechanical ventilation in the first hour of admission was not significant between the groups (25.17% vs. 24.22%, p 0.895). The implementation of the EAS resulted in a statistically significant reduction in the mortality rate among the patients admitted to the PICU in our study. An EAS can play an important role in saving lives and subsequent reduction in healthcare costs. Further enhancement of systematic screening is therefore highly recommended to improve the prognosis of pediatric SIRS and sepsis. The implementation of the EAS, warrants further validation in multicenter or national studies.

Economic Perspective of Cancer Care and Its Consequences for Vulnerable Groups

Simple Summary

For cancer patients, many different reasons can cause financial burdens and economic threads. Sociodemographic factors, rural/remote location and income are known determinants for these vulnerable groups. This economic vulnerability is related to the reduced utilization of cancer care and the impact on outcome. Financial burden has been reported in many countries throughout the world and needs to be addressed as part of the sufficient quality of cancer care.

Abstract

Within healthcare systems in all countries, vulnerable groups of patients can be identified and are characterized by the reduced utilization of available healthcare. Many different reasons can be attributed to this observation, summarized as implementation barriers involving acceptance, accessibility, affordability, acceptability and quality of care. For many patients, cancer care is specifically associated with the occurrence of vulnerability due to the complex disease, very different target groups and delivery situations (from prevention to palliative care) as well as cost-intensive care. Sociodemographic factors, such as educational level, rural/remote location and income, are known determinants for these vulnerable groups. However, different forms of financial burdens likely influence this vulnerability in cancer care delivery in a distinct manner. In a narrative review, these socioeconomic challenges are summarized regarding their occurrence and consequences to current cancer care. Overall, besides direct costs such as for treatment, many facets of indirect costs including survivorship costs for the cancer patients and their social environment need to be considered regarding the impact on vulnerability, treatment compliance and abundance. In addition, individual cancer-related financial burden might also affect the society due to the loss of productivity and workforce availability. Healthcare providers are requested to address this vulnerability during the treatment of cancer patients.

Challenges to sustainability of pediatric early warning systems (PEWS) in low-resource hospitals in Latin America

Background

Sustainability, or continued use of evidence-based interventions for long-term patient benefit, is the least studied aspect of implementation science. In this study, we evaluate sustainability of a Pediatric Early Warning System (PEWS), an evidence-based intervention to improve early identification of clinical deterioration in hospitalized children, in low-resource settings using the Clinical Capacity for Sustainability Framework (CCS).

Methods

We conducted a secondary analysis of a qualitative study to identify barriers and enablers to PEWS implementation. Semi-structured interviews with PEWS implementation leaders and hospital directors at 5 Latin American pediatric oncology centers sustaining PEWS were conducted virtually in Spanish from June to August 2020. Interviews were recorded, professionally transcribed, and translated into English. Exploratory thematic content analysis yielded staff perceptions on PEWS sustainability. Coded segments were analyzed to identify participant perception about the current state and importance of sustaining PEWS, as well as sustainability successes and challenges. Identified sustainability determinants were mapped to the CCS to evaluate its applicability.

Results

We interviewed 71 staff including physicians (45%), nurses (45%), and administrators (10%). Participants emphasized the importance of sustaining PEWS for continued patient benefits. Identified sustainability determinants included supportive leadership encouraging ongoing interest in PEWS, beneficial patient outcomes enhancing perceived value of PEWS, integrating PEWS into the routine of patient care, ongoing staff turnover creating training challenges, adequate material resources to promote PEWS use, and the COVID-19 pandemic. While most identified factors mapped to the CCS, COVID-19 emerged as an additional external sustainability challenge. Together, these challenges resulted in multiple impacts on PEWS sustainment, ranging from a small reduction in PEWS quality to complete disruption of PEWS use and subsequent loss of benefits to patients. Participants described several innovative strategies to address identified challenges and promote PEWS sustainability.

Conclusion

This study describes clinician perspectives on sustainable implementation of evidence-based interventions in low-resource settings, including sustainability determinants and potential sustainability strategies. Identified factors mapped well to the CCS, however, external factors, such as the COVID pandemic, may additionally impact sustainability. This work highlights an urgent need for theoretically-driven, empirically-informed strategies to support sustainable implementation of evidence-based interventions in settings of all resource-levels.

Reliability and validity of a Spanish-language measure assessing clinical capacity to sustain Paediatric Early Warning Systems (PEWS) in resource-limited hospitals

BACKGROUND

Paediatric Early Warning Systems (PEWSs) improve identification of deterioration, however, their sustainability has not been studied. Sustainability is critical to maximise impact of interventions like PEWS, particularly in low-resource settings. This study establishes the reliability and validity of a Spanish-language Clinical Sustainability Assessment Tool (CSAT) to assess clinical capacity to sustain interventions in resource-limited hospitals.

METHODS

Participants included PEWS implementation leadership teams of 29 paediatric cancer centres in Latin America involved in a collaborative to implement PEWS. The CSAT, a sustainability assessment tool validated in high-resource settings, was translated into Spanish and distributed to participants as an anonymous electronic survey. Psychometric, confirmatory factor analysis (CFA), and multivariate analyses were preformed to assess reliability, structure and initial validity. Focus groups were conducted after participants reviewed CSAT reports to assess their interpretation and utility.

RESULTS

The CSAT survey achieved an 80% response rate (n=169) with a mean score of 4.4 (of 5; 3.8-4.8 among centres). The CSAT had good reliability with an average internal consistency of 0.77 (95% CI 0.71 to 0.81); and CFAs supported the seven-domain structure. CSAT results were associated with respondents' perceptions of the evidence for PEWS, its implementation and use in their centre, and their assessment of the hospital culture and implementation climate. The mean CSAT score was higher among respondents at centres with longer time using PEWS (p<0.001). Focus group participants noted the CSAT report helped assess their centre's clinical capacity to sustain PEWS and provided constructive feedback for improvement.

CONCLUSIONS

We present information supporting the reliability and validity of the CSAT tool, the first Spanish-language instrument to assess clinical capacity to sustain evidence-based interventions in hospitals of variable resource levels. This assessment demonstrates a high capacity to sustain PEWS in these resource-limited centres with improvement over time from PEWS implementation.

Qualitative Study of Pediatric Early Warning Systems' Impact on Interdisciplinary Communication in Two Pediatric Oncology Hospitals With Varying Resources

PURPOSE

Hospitalized pediatric oncology patients are at high risk of deterioration and require frequent interdisciplinary communication to deliver high-quality care. Pediatric early warning systems (PEWS) are used by hospitals to reduce deterioration, but it is unknown how these systems affect communication about patient care in high- and limited-resource pediatric oncology settings.

METHODS

This qualitative study included semistructured interviews describing PEWS and subsequent team communication at 2 pediatric cancer centers, 1 in the United States and 1 in Guatemala. Participants included nurses, and frontline and intensive care providers who experienced recent deterioration events. Transcripts were coded and analyzed inductively using MAXQDA software.

RESULTS

The study included 41 providers in Guatemala and 42 providers in the United States (33 nurses, 30 ward providers, and 20 pediatric intensive care providers). Major themes identified include “hierarchy,” “empowerment,” “quality and method of communication,” and “trigger.” All providers described underlying medical hierarchies affecting the quality of communication regarding patient deterioration events and identified PEWS as empowering. Participants from the United States described the algorithmic approach to care and technology associated with PEWS contributing to impaired clinical judgement and a lack of communication. In both settings, PEWS sparked interdisciplinary communication and inspired action.

CONCLUSION

PEWS enhance interdisciplinary communication in high- and limited-resource study settings by empowering bedside providers. Traditional hierarchies contributed to negative communication and, in well-resourced settings, technology and automation resulted in lack of communication. Understanding contextual elements is integral to optimizing PEWS and improving pediatric oncology outcomes in hospitals of all resource levels.

How to implement a PEWS in a resource-limited setting: A quantitative analysis of the bedside-PEWS implementation in a hospital in northeast Brazil

OBJECTIVES

Quantitative analysis of the implementation of the bedside paediatric early warning system (B-PEWS) in a resource-limited setting. The B-PEWS serves to pre-emptively identify hospitalised children who are at risk for cardiopulmonary arrest and subsequently to provide critical care in time.

METHODS

We performed a retrospective review through the medical data records of patients after discharge from the paediatric ward of a philanthropic hospital in Brazil. Nurses' performance using the system was measured with various parameters.

RESULTS

A total of 499 patients were included, and a total of 8024 scores were checked. During the 21-week research period, the implementation rate increased significantly from 66.5% (SD 26.0) in Period 1 to 93.1% (SD 16.6) in Period 2. The number of scores that resulted in a correct total score went from 7.5% in Period 1 to 32.2% in Period 2, p < 0.001. There was an improvement in the correct choice of age group between the two periods (from 32.2% to 53.4%). There was no difference in the mean admission time of patients in the two periods: in the first period 4.8 days (SD 2.9) and in the second period 4.8 days (SD 4.1).

CONCLUSIONS

It is possible to implement a PEWS in resource-limited settings while achieving high implementation rates. However, this is a time- and energy-consuming process. Having an active and involved team that is responsible for implementation is key for a successful implementation. Factors that likely hindered implementation were a large change in workflow for the nursing staff, non-native speakers as main investigators.

Impact of PEWS on Perceived Quality of Care During Deterioration in Children With Cancer Hospitalized in Different Resource-Settings

Background

Children with cancer are at high risk for clinical deterioration and subsequent mortality. Pediatric Early Warning Systems (PEWS) have proven to reduce the frequency of clinical deterioration in hospitalized patients. This qualitative study evaluates provider perspectives on the impact of PEWS on quality of care during deterioration events in a high-resource and a resource-limited setting.

Methods

We conducted semi-structured interviews with 83 healthcare staff (nurses, pediatricians, oncology fellows, and intensivists) involved in recent deterioration events at two pediatric oncology hospitals of different resource levels: St. Jude Children’s Research Hospital (SJCRH; n = 42) and Unidad Nacional de Oncología Pediátrica (UNOP; n = 41). Interviews were conducted in the participant’s native language (English or Spanish), translated into English, and transcribed. Transcripts were coded and analyzed inductively.

Results

Providers discussed both positive and negative perspectives of clinical deterioration events. Content analysis revealed “teamwork,” “experience with deterioration,” “early awareness,” and “effective communication” as themes associated with positive perception of events, which contributed to patient safety. Negative themes included “lack of communication,” “inexperience with deterioration,” “challenges with technology”, “limited material resources,” “false positive score,” and “objective tool.” Participants representing all disciplines across both institutions shared similar positive opinions. Negative opinions, however, differed between the two institutions, with providers at UNOP highlighting limited resources while those at SJCRH expressing concerns about technology misuse.

Conclusion

Providers that care for children with cancer find PEWS valuable to improve the quality of hospital care, regardless of hospital resource-level. Identified challenges, including inadequate critical care resources and challenges with technology, differ by hospital resource-level. These findings build on growing data demonstrating the positive impact of PEWS on quality of care and encourage wide dissemination of PEWS in clinical practice.

Pediatric Oncology Nursing Research in Low- and Middle-Income Countries: Exemplars from Three Regions

OBJECTIVE

This study examined the status of pediatric oncology nursing research in three low- and middle-income countries (LMICs) as examples across three World Health Organization regions: East Africa, Eastern Mediterranean region, and Latin America.

DATA SOURCES

Published literature was identified from Google Scholar, PubMed, Scielo, Virtual Health Library, and reference lists of some articles.

CONCLUSION

The experiences of the three LMIC pediatric oncology nurses illustrate the situation of nurse research in their setting and identify relevant published literature. The authors highlight the challenges for nurses to conduct research (eg, lack of training, mentors, funding, and opportunities). Local evidence to inform nursing practice in LMICs is needed. Recommendations for ameliorating the situation include increased advanced practice nurse education, physician and hospital support, funding, and protected time.

IMPLICATIONS FOR NURSING PRACTICE

Pediatric oncology nursing practice is culturally and context-driven and requires locally acquired evidence to support best practices. Only when sufficient, sustainable, and local nursing research training and education is available in LMICs, will this evidence be generated. Nursing research training (eg, master's and PhD programs), funding, and protected time are three key steps to guide and motivate staff nurses as well as academic nurses to participate in research that informs the care of children and adolescents with cancer across all countries and not only those with significant resources.

Clinician Emotions Surrounding Pediatric Oncology Patient Deterioration

Background

Pediatric oncology patients have a high rate of clinical deterioration frequently requiring critical care. Patient deterioration events are distressing for clinicians, but little is known about how Pediatric Early Warning Systems (PEWS) impact clinicians' emotional responses to deterioration events.

Methods

Semi-structured interviews were conducted with 83 nurses, pediatricians, oncologists, and intensive care clinicians who had recently participated in a patient deterioration event at two pediatric oncology hospitals of different resource-levels: St. Jude Children's Research Hospital (N = 42 participants) in Memphis, Tennessee or Unidad Nacional de Oncología Pediátrica (N = 41 participants) in Guatemala City, Guatemala. Interviews were conducted in the participants' native language (English or Spanish), transcribed, and translated into English. Each transcript was coded by two researchers and analyzed for thematic content.

Results

Emotions around patient deterioration including concern, fear, and frustration were reported across all disciplines at both hospitals. Concern was often triggered by an elevated PEWS score and usually resulted in increased attention, which reassured bedside clinicians that patients were receiving necessary interventions. However, persistently elevated PEWS scores, particularly at St. Jude Children's Research Hospital, occasionally resulted in a false sense of relief, diminishing clinician attention and negatively impacting patient care. Nurses at both institutions described how PEWS amplified their voices, engendering confidence and empowerment, two of the only positive emotions described in the study.

Conclusion

Clinicians experienced a range of emotions while caring for high-risk patients in the setting of clinical deterioration. These emotions have the potential to contribute to compassion fatigue and burnout, or to resilience. Acknowledgment and further investigation of the complex interplay between PEWS and clinician emotions are necessary to maximize the impact of PEWS on patient safety while simultaneously supporting staff wellbeing.

Quality and capacity indicators for hospitalized pediatric oncology patients with critical illness: A modified delphi consensus

Background

Hospitalized pediatric hematology‐oncology (PHO) patients are at high risk for critical illness, especially in resource‐limited settings. Unfortunately, there are no established quality indicators to guide institutional improvement for these patients. The objective of this study was to identify quality indicators to include in PROACTIVE (PediatRic Oncology cApaCity assessment Tool for IntensiVe carE), an assessment tool to evaluate the capacity and quality of pediatric critical care services offered to PHO patients.

Methods

A comprehensive literature review identified relevant indicators in the areas of structure, performance, and outcomes. An international focus group sorted potential indicators using the framework of domains and subdomains. A modified, three‐round Delphi was conducted among 36 international experts with diverse experience in PHO and critical care in high‐resource and resource‐limited settings. Quality indicators were ranked on relevance and actionability via electronically distributed surveys.

Results

PROACTIVE contains 119 indicators among eight domains and 22 subdomains, with high‐median importance (≥7) in both relevance and actionability, and ≥80% evaluator agreement. The top five indicators were: (a) A designated PICU area; (b) Availability of a pediatric intensivist; (c) A PHO physician as part of the primary team caring for critically ill PHO patients; (d) Trained nursing staff in pediatric critical care; and (e) Timely PICU transfer of hospitalized PHO patients requiring escalation of care.

Conclusions

PROACTIVE is a consensus‐derived tool to assess the capacity and quality of pediatric onco‐critical care in resource‐limited settings. Future endeavors include validation of PROACTIVE by correlating the proposed indicators to clinical outcomes and its implementation to identify service delivery gaps amenable to improvement.