Competing risk survival analysis of time to in-hospital death or discharge in a large urban neonatal unit in Kenya

Mortality by Admission Diagnosis in Children 1-60 Months of Age Admitted to a Tertiary Care Government Hospital in Malawi

Diagnosis-specific mortality is a measure of pediatric healthcare quality that has been incompletely studied in sub-Saharan African hospitals. Identifying the mortality rates of multiple conditions at the same hospital may allow leaders to better target areas for intervention. In this secondary analysis of routinely collected data, we investigated hospital mortality by admission diagnosis in children aged 1-60 months admitted to a tertiary care government referral hospital in Malawi between October 2017 and June 2020. The mortality rate by diagnosis was calculated as the number of deaths among children admitted with a diagnosis divided by the number of children admitted with the same diagnosis. There were 24,452 admitted children eligible for analysis. Discharge disposition was recorded in 94.2% of patients, and 4.0% (N = 977) died in the hospital. The most frequent diagnoses among admissions and deaths were pneumonia/bronchiolitis, malaria, and sepsis. The highest mortality rates by diagnosis were found in surgical conditions (16.1%; 95% CI: 12.0-20.3), malnutrition (15.8%; 95% CI: 13.6-18.0), and congenital heart disease (14.5%; 95% CI: 9.9-19.2). Diagnoses with the highest mortality rates were alike in their need for significant human and material resources for medical care. Improving mortality in this population will require sustained capacity building in conjunction with targeted quality improvement initiatives against both common and deadly diseases.

External validation of inpatient neonatal mortality prediction models in high-mortality settings

BACKGROUND

Two neonatal mortality prediction models, the Neonatal Essential Treatment Score (NETS) which uses treatments prescribed at admission and the Score for Essential Neonatal Symptoms and Signs (SENSS) which uses basic clinical signs, were derived in high-mortality, low-resource settings to utilise data more likely to be available in these settings. In this study, we evaluate the predictive accuracy of two neonatal prediction models for all-cause in-hospital mortality.

METHODS

We used retrospectively collected routine clinical data recorded by duty clinicians at admission from 16 Kenyan hospitals used to externally validate and update the SENSS and NETS models that were initially developed from the data from the largest Kenyan maternity hospital to predict in-hospital mortality. Model performance was evaluated by assessing discrimination and calibration. Discrimination, the ability of the model to differentiate between those with and without the outcome, was measured using the c-statistic. Calibration, the agreement between predictions from the model and what was observed, was measured using the calibration intercept and slope (with values of 0 and 1 denoting perfect calibration).

RESULTS

At initial external validation, the estimated mortality risks from the original SENSS and NETS models were markedly overestimated with calibration intercepts of - 0.703 (95% CI - 0.738 to - 0.669) and - 1.109 (95% CI - 1.148 to - 1.069) and too extreme with calibration slopes of 0.565 (95% CI 0.552 to 0.577) and 0.466 (95% CI 0.451 to 0.480), respectively. After model updating, the calibration of the model improved. The updated SENSS and NETS models had calibration intercepts of 0.311 (95% CI 0.282 to 0.350) and 0.032 (95% CI - 0.002 to 0.066) and calibration slopes of 1.029 (95% CI 1.006 to 1.051) and 0.799 (95% CI 0.774 to 0.823), respectively, while showing good discrimination with c-statistics of 0.834 (95% CI 0.829 to 0.839) and 0.775 (95% CI 0.768 to 0.782), respectively. The overall calibration performance of the updated SENSS and NETS models was better than any existing neonatal in-hospital mortality prediction models externally validated for settings comparable to Kenya.

CONCLUSION

Few prediction models undergo rigorous external validation. We show how external validation using data from multiple locations enables model updating and improving their performance and potential value. The improved models indicate it is possible to predict in-hospital mortality using either treatments or signs and symptoms derived from routine neonatal data from low-resource hospital settings also making possible their use for case-mix adjustment when contrasting similar hospital settings.

Quantitative decision making for investment in global health intervention trials: Case study of the NEWBORN study on emollient therapy in preterm infants in Kenya

Background

Partners from an NGO, academia, industry and government applied a tool originating in the private sector – Quantitative Decision Making (QDM) – to rigorously assess whether to invest in testing a global health intervention. The proposed NEWBORN study was designed to assess whether topical emollient therapy with sunflower seed oil in infants with very low birthweight <1500 g in Kenya would result in a significant reduction in neonatal mortality compared to standard of care.

Methods

The QDM process consisted of prior elicitation, modelling of prior distributions, and simulations to assess Probability of Success (PoS) via assurance calculations. Expert opinion was elicited on the probability that emollient therapy with sunflower seed oil will have any measurable benefit on neonatal mortality based on available evidence. The distribution of effect sizes was modelled and trial data simulated using Statistical Analysis System to obtain the overall assurance which represents the PoS for the planned study. A decision-making framework was then applied to characterise the ability of the study to meet pre-selected decision-making endpoints.

Results

There was a 47% chance of a positive outcome (defined as a significant relative reduction in mortality of ≥15%), a 45% chance of a negative outcome (defined as a significant relative reduction in mortality <10%), and an 8% chance of ending in the consider zone (ie, a mortality reduction of 10 to <15%) for infants <1500 g.

Conclusions

QDM is a novel tool from industry which has utility for prioritisation of investments in global health, complementing existing tools [eg, Child Health and Nutrition Research Initiative]. Results from application of QDM to the NEWBORN study suggests that it has a high probability of producing clear results. Findings encourage future formation of public-private partnerships for health.

Neonatal mortality in Kenyan hospitals: a multisite, retrospective, cohort study

BACKGROUND

Most of the deaths among neonates in low-income and middle-income countries (LMICs) can be prevented through universal access to basic high-quality health services including essential facility-based inpatient care. However, poor routine data undermines data-informed efforts to monitor and promote improvements in the quality of newborn care across hospitals.

METHODS

Continuously collected routine patients' data from structured paper record forms for all admissions to newborn units (NBUs) from 16 purposively selected Kenyan public hospitals that are part of a clinical information network were analysed together with data from all paediatric admissions ages 0-13 years from 14 of these hospitals. Data are used to show the proportion of all admissions and deaths in the neonatal age group and examine morbidity and mortality patterns, stratified by birth weight, and their variation across hospitals.

FINDINGS

During the 354 hospital months study period, 90 222 patients were admitted to the 14 hospitals contributing NBU and general paediatric ward data. 46% of all the admissions were neonates (aged 0-28 days), but they accounted for 66% of the deaths in the age group 0-13 years. 41 657 inborn neonates were admitted in the NBUs across the 16 hospitals during the study period. 4266/41 657 died giving a crude mortality rate of 10.2% (95% CI 9.97% to 10.55%), with 60% of these deaths occurring on the first-day of admission. Intrapartum-related complications was the single most common diagnosis among the neonates with birth weight of 2000 g or more who died. A threefold variation in mortality across hospitals was observed for birth weight categories 1000-1499 g and 1500-1999 g.

INTERPRETATION

The high proportion of neonatal deaths in hospitals may reflect changing patterns of childhood mortality. Majority of newborns died of preventable causes (>95%). Despite availability of high-impact low-cost interventions, hospitals have high and very variable mortality proportions after stratification by birth weight.

Prediction modelling of inpatient neonatal mortality in high-mortality settings

OBJECTIVE

Prognostic models aid clinical decision making and evaluation of hospital performance. Existing neonatal prognostic models typically use physiological measures that are often not available, such as pulse oximetry values, in routine practice in low-resource settings. We aimed to develop and validate two novel models to predict all cause in-hospital mortality following neonatal unit admission in a low-resource, high-mortality setting.

STUDY DESIGN AND SETTING

We used basic, routine clinical data recorded by duty clinicians at the time of admission to derive (n=5427) and validate (n=1627) two novel models to predict in-hospital mortality. The Neonatal Essential Treatment Score (NETS) included treatments prescribed at the time of admission while the Score for Essential Neonatal Symptoms and Signs (SENSS) used basic clinical signs. Logistic regression was used, and performance was evaluated using discrimination and calibration.

RESULTS

At derivation, c-statistic (discrimination) for NETS was 0.92 (95% CI 0.90 to 0.93) and that for SENSS was 0.91 (95% CI 0.89 to 0.93). At external (temporal) validation, NETS had a c-statistic of 0.89 (95% CI 0.86 to 0.92) and SENSS 0.89 (95% CI 0.84 to 0.93). The calibration intercept for NETS was -0.72 (95% CI -0.96 to -0.49) and that for SENSS was -0.33 (95% CI -0.56 to -0.11).

CONCLUSION

Using routine neonatal data in a low-resource setting, we found that it is possible to predict in-hospital mortality using either treatments or signs and symptoms. Further validation of these models may support their use in treatment decisions and for case-mix adjustment to help understand performance variation across hospitals.

Data for tracking SDGs: challenges in capturing neonatal data from hospitals in Kenya

Background

Target 3.2 of the United Nations Sustainable Development Goals (SDGs) is to reduce neonatal mortality. In low-income and middle-income countries (LMICs), the District Health Information Software, V.2 (DHIS2) is widely used to help improve indicator data reporting. There are few reports on its use for collecting neonatal hospital data that are of increasing importance as births within facilities increase. To address this gap, we investigated implementation experiences of DHIS2 in LMICs and mapped the information flow relevant for neonatal data reporting in Kenyan hospitals.

Methods

A narrative review of published literature and policy documents from LMICs was conducted. Information gathered was used to identify the challenges around DHIS2 and to map information flows from healthcare facilities to the national level. Two use cases explore how newborn data collection and reporting happens in hospitals. The results were validated, adjusted and system challenges identified.

Results

Literature and policy documents report that DHIS2 is a useful tool with strong technical capabilities, but significant challenges can emerge with the implementation. Visualisations of information flows highlight how a complex, people-based and paper-based subsystem for inpatient information capture precedes digitisation. Use cases point to major challenges in these subsystems in accurately identifying newborn deaths and appropriate data for the calculation of mortality even in hospitals.

Conclusions

DHIS2 is a tool with potential to improve availability of health information that is key to health systems, but it critically depends on people-based and paper-based subsystems. In hospitals, the subsystems are subject to multiple micro level challenges. Work is needed to design and implement better standardised information processes, recording and reporting tools, and to strengthen the information system workforce. If the challenges are addressed and data quality improved, DHIS2 can support countries to track progress towards the SDG target of improving neonatal mortality.